The Decline of the Experimental Paradigm During the COVID-19 Pandemic: A Template for the Future

Abstract

The current Coronavirus Disease 2019 (COVID-19) pandemic has exerted an unprecedented impact across the globe. As a consequence of this overwhelming catastrophe, long-established prevailing medical and scientific paradigms have been disrupted. The response of the scientific community, medical journals, media, and some politicians has been far from ideal. The present manuscript discusses the failure of the scientific enterprise in its initiatives to address the COVID-19 outbreak as a consequence of the disarray attributable to haste and urgency. To enhance conveying our message, this manuscript is organized into 3 interrelated sections: 1) the accelerated pace of publications coupled with a dysfunctional review process; 2) failure of the clinical trial enterprise; 3) propagation of misleading information by the media. In response we propose a template comprising a focus on randomized controlled clinical trials, and an insistence on responsible journal publication, and enumeration of policies to deal with social media-propagated news. We conclude with a reconsideration of the appropriate role of academic medicine and journals.

Clinical Significance.

• •The COVID-19 outbreak has exposed major gaps within the scientific world.
• •The lack of coordination between countries and institutions, and the haste of publishing, has led to a massive output of observational studies.
• •International organizations and medical journals must be rendered accountable in the coordination and quality control of scientific output.
• •A fact-check system should be adopted by the media separating what is misleading or false from what is credible.

Alt-text: Unlabelled box

Introduction

As of the most recent October 2020 update, the current Coronavirus Disease 2019 (COVID-19) pandemic has exerted an unprecedented impact across the globe. More than 33 million cases and over 1 million deaths.¹

The World Health Organization (WHO) has recommended “lockdown” to limit the spread of the virus and many countries have closed their borders, disrupting the global economy. Pressure has also increased on health care systems, attributable to a steep increase in patients requiring acute care and respiratory and circulatory support, and also by increasing the demand for the rapid testing of the safety and efficacy of novel treatments. As a consequence, there has been a disruption of the evidence-based scientific paradigms that are essential for maintaining public health. The short-term consequences of this disruption can readily be observed. For example, off-label use of medications without credible proof of benefit (eg, hydroxychloroquine), companies rushing to market vaccines without the requisite robust evidence of efficacy and safety, the downgrading of the role of disease-control agencies, and distrust of scientific expertise.² While the long-term consequences are yet to be seen, a recent projection foreshadows a growing trend in antivaccination movements.³

In the context of this escalating chaos, how has the scientific community responded? What has been the role of medical journals? How has scientifically rigorous information been disseminated? What follows is an overview of how the response to the COVID-19 pandemic has disrupted the norms for reliable data acquisition, analysis, and dissemination. We then adopt a constructive tenor and propose a template comprising a focus on randomized controlled clinical trials, and an insistence on responsible journal publication policies to deal with social media-propagated news.

For ease of presentation we have organized this manuscript into 3 interrelated sections: 1) an accelerated pace of publication; 2) failure of the clinical trial enterprise; 3) media dysfunction and the propagation of misinformation. Importantly, we propose a template comprising a focus on randomized controlled clinical trials, and an insistence on responsible journal publication policies to deal with social media-propagated news, with reconsideration of the appropriate role of academic medical faculties and journals.

Accelerated Pace of Publications

The COVID-19 pandemic has resulted in a deluge of academic papers being published about the novel coronavirus in one of the greatest explosions of scientific literature ever observed. Professional organizations charged with grading scientific evidence are overwhelmed by the pace of publications. Researchers and clinicians have no time to keep up with the torrent of manuscripts coming out daily.⁴ Moreover, many of these publications have not been peer-reviewed and are widely available solely as preprint manuscripts, while others may have been peer-reviewed but lack quality and scientific rigor.^{5 , 6} Regardless of their quality and whether or not they have been peer-reviewed, many of these manuscripts are treated equally and shared widely on social media and are frequently picked up by numerous news outlets. This has led the preprint server “bioRxiv” to add a yellow banner warning on all new publications of coronavirus research saying: “A reminder: these are preliminary reports that have not been peer-reviewed. They should not be regarded as conclusive, guide clinical practice/health-related behaviour, or be reported in news media as established information.” Consequently, it is appropriate to ask, why publish them?

In a technological era where a tweet or a Facebook feed may provoke more impact than a well-planned and diligently executed scientific project, we must rigorously question where the science stands currently, for the sake of transparency, rigor, and public trust. The quantity of manuscripts being published suggests that many of these may be observational or small trials with poor oversight, resulting in inappropriately hasty publication. But because good science requires discipline, caution, validation, and replication, the current rapid pace of publications may be contributing to more confusion among the public and to an overall decline in scientific trust.⁷ The failure to conduct large-scale hypothesis-driven randomized controlled trials, in concert with haste for fast-track publications, has added little to the treatment, and especially the prevention, of the novel coronavirus.

Failure of the Clinical Trial Enterprise

Randomized controlled trials (RCTs) are the gold standard test of whether or not a treatment is beneficial.8, 9, 10 The numerous biases and limitations of nonrandomized, observational studies have been thoroughly documented and are detailed in Table 1 . It must be emphasized, however, that underpowered and poorly conducted RCTs are equally prone to bias and spurious findings.¹¹ Regretfully, observational, poor-quality randomized and good-quality randomized studies are allocated similar press coverage and dissemination.¹² The growing access to large sets of data from thousands of patients and multiple data sources (ie, “big data”) has prompted many researchers to erroneously claim an accurate determination of treatment effects from nonrandomized studies.^{13 , 14} Although this approach may be used in unique settings wherein it is not feasible to perform an RCT, it should not be used to replace RCTs in settings where RCTs can (and should) be performed—as in the current coronavirus crisis.^{10 ,} 15, 16, 17, 18 Additionally, using “big data” in the absence of a prespecified power calculation, expected event rates, treatment effects, and follow-up time (ie, all prespecified parameters of RCTs) is fraught with errors (Table 1).19, 20, 21

Table 1.

Bias (Deviation from the Truth) of Observational Studies

Bias	What Is It?	Example
Selection bias	The groups being studied are not comparable because they were not selected at random	Patients taking antihypertensive medication may have poorer outcome, not because of the medication but because they are sicker, that is, they represent a group of sicker people
Information bias	Incorrect determination of exposure, outcome, or both	Information about a treatment or an event is collected differently across patient populations, for example, hospital records vs phone calls vs face-to-face visits
Confounding	The association between the exposure and outcome is determined by another factor that can be measured or unmeasured	The association between a treatment for diabetes and outcome may be determined by the patients’ income or access to health care, for example, poorer people may not have insurance to cover their health expenses
Exaggeration of the effect	The magnitude of the effect seems greater on a relative scale than what it actually is on an absolute scale	In the absence of a prespecified sample size/events and expected treatment effect, an observational study may report an “important” relative effect even in the setting of a low event rate and small difference in events. For example, an outcome affecting 1.7% of the population on the “exposed/treated” and 1.3% on the “nonexposed/treated” may give an odds (or hazards) ratio around 1.3, which is usually translated by a “30% increase of event,” but the absolute difference is 0.4%, which should be translated into a 0.4% increase and not 30%.

Given these limitations, the results from observational studies should be regarded as “hypothesis-generating” to be tested in randomized controlled trials; observational studies should not guide treatment decisions.

During the COVID-19 outbreak, many observational studies claiming treatment effects have been reported in top-tier medical journals with the inherent limitations described above (and in Table 1),22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35 together with a few small-scale or open-label RCTs,36, 37, 38, 39, 40, 41, 42, 43 and no large-scale, international, well-powered, double-blinded RCT.

Observational studies can also jeopardize ongoing RCTs. For example, the recent publication (and subsequent retraction) of an observational study showing a possible deleterious effect of hydroxychloroquine and chloroquine for the treatment of COVID-19³² has prompted many ongoing trials to withhold the hydroxychloroquine arm. Because of the context, the decision of pausing the randomization to hydroxychloroquine might have been inevitable, simply because the patients started to express concern about participating in the trials.⁴⁴ While intermediate analysis could be informative, much more informative is to complete the trials as planned.⁴⁵ The recent retraction of manuscripts with data emanating from Surgisphere (Palatine, Ill)^{23 , 32} highlights the failure of adherence to good science practices (access to the original data source denied by Surgisphere) and of peer-reviewing and editorial oversight (not having vetted quality control of the database prior to their publication). The confusion caused by these episodes exposes researchers to the “double whammy” of 1) further disruption of RCT timely evidence generation, and 2) loss of confidence of the patients eligible for inclusion in the ongoing clinical trials. In a constructive vein, we have provided a framework to support and enhance the efforts of editors and reviewers in the handling of observational analyses, as shown in Table 2 .

Table 2.

Framework to Support Editors and Reviewers in the Handling of Observational Analyses

Checklist	Comment
•Participants must provide informed consent for participation in the study	Data coming from sources without proof of signed informed consent should not be taken seriously
•The study must have ethical approval from a clearly identified and reachable ethics committee	Data that do not meet ethical standards should not be considered for publication
•Clear information about the data oversight and management must be provided	The people responsible for the data oversight and data-management must be identified and reachable if required
•Clear information about the statistical approach must be provided and a statistical analysis plan (SAP) should be available	The statistical methods must be very detailed, including on the handling of missing data and rationale of the adjustment technique used; the statistician(s) must be reachable and accountable. Whenever possible, the SAP should be published before the analysis is performed.
•The data should be available upon reasonable request	The full dataset used for the analysis should be available for independent verification. For example, upon request from a journal
•The study should be registered in an official agency	It is strongly recommended a prior registry of the cohort along with its description (eg, in ClinicalTrials.gov)
•The study should have well-defined entry criteria, comparator arm, sample size calculation, outcomes of interest, and follow-up/exposure time	Observational studies should mimic the standards used for randomized trials

Along with the multiple observational studies, some RCTs have also been published. Many of these RCTs have important methodological caveats that render their conclusions nondefinitive. A critical interpretation of these RCTs is presented in Table 3 .36, 37, 38, 39, 40, 41, 42, 43 Overall, our critique demonstrates a clear failure of the clinical trial enterprise, revealing a lack of coordination and international cooperation required to facilitate large, high-quality RCTs that could potentially respond to patients’ needs in a scientifically valid and timely manner.⁴⁶

Table 3.

Critical Appraisal of the COVID-19 Randomized Controlled Trials

Study	Patients	Treatments	Main Findings	Methodological Issues
A Trial of Lopinavir–Ritonavir in Adults Hospitalized with Severe COVID-1936 Chinese Clinical Trial Register identifier, ChiCTR2000029308	199 adult patients hospitalized with confirmed SARS-CoV-2 infection	1:1 assignment of lopinavir–ritonavir (400 mg and 100 mg, respectively) 2×/d plus standard care vs standard care alone for 14 d	Lopinavir–ritonavir was not different from standard care in the time to clinical improvement.	The trial was not blinded, which could have influenced decision-making and the use of concomitant treatments.
Triple Combination of Interferon Beta-1b, Lopinavir–Ritonavir, and Ribavirin in the Treatment of Patients Admitted to Hospital with COVID-19: an Open-Label, Randomized, Phase 2 Trial37 ClinicalTrials.gov identifier, NCT04276688	127 adult patients hospitalized with confirmed SARS-CoV-2 infection	2:1 assignment to a combination of lopinavir–ritonavir (400 mg and 100 mg, respectively) 2×/d, ribavirin 400 mg 2×/d, and three doses of 8 million IU of interferon beta-1b on alternate days (combination group) or lopinavir–ritonavir (400 mg and 100 mg, respectively) 2×/d (control group) for 14 d	The combination group had a significantly shorter median time from start of study treatment to negative nasopharyngeal swab.	The trial was not blinded, which could have influenced decision-making and the use of concomitant treatments.
Remdesivir in Adults with Severe COVID 19: A Randomized, Double-Blind, Placebo-Controlled, Multicenter Trial38	237 adult patients hospitalized with confirmed SARS-CoV-2 infection	2:1 ratio assignment to intravenous remdesivir (200 mg on day 1 followed by 100 mg on days 2-10 in 1×/d) or the same volume of placebo infusions for 10 d	Remdesivir was not associated with statistically significant clinical benefits.	Exaggerated claims of treatment effect not supported by the data.
Remdesivir for the Treatment of Covid-19 – Preliminary Report39 Adaptive COVID-19 Treatment Trial (ACTT). ClinicalTrials.gov identifier, NCT04280705	1063 adult patients hospitalized with confirmed SARS-CoV-2 infection	1:1 ratio assignment to intravenous remdesivir (200 mg on day 1 followed by 100 mg on days 2–10 in 1×/d) or the same volume of placebo infusions for 10 d	Remdesivir reduced the time to recovery (median: 11 vs 15 d).	Treatment cross-over. Early trial stop.
Remdesivir for 5 or 10 Days in Patients with Severe Covid-1940 Study to evaluate the safety and antiviral activity of remdesivir (GS-5734) in participants with severe Coronavirus Disease (COVID-19). ClinicalTrials.gov identifier, NCT04292899	397 adult patients hospitalized with confirmed SARS-CoV-2 infection, oxygen saturation of 94% or less (in ambient air), and radiologic evidence of pneumonia	1:1 ratio assignment to intravenous remdesivir (200 mg on day 1 followed by 100 mg on subsequent days) for either 5 or 10 d	No difference between a 5-d course and a 10-d course of remdesivir was found.	Open label. No placebo control arm.
A Randomized Trial of Hydroxychloroquine as Postexposure Prophylaxis for COVID-1941 ClinicalTrials.gov identifier, NCT04308668	821 asymptomatic participants who had household or occupational exposure to someone with confirmed COVID-19	Participants were randomly assigned to receive either placebo or hydroxychloroquine (800 mg once, followed by 600 mg in 6 to 8 h, then 600 mg daily for 4 additional d) within 4 d after exposure	Hydroxychloroquine did not prevent illness compatible with COVID-19 or confirmed infection.	No consistent proof of exposure to SARS-CoV-2 or laboratory confirmation. Young patients with few comorbid conditions who are less likely to develop severe disease.
Effect of Convalescent Plasma Therapy on Time to Clinical Improvement in Patients with Severe and Life-threatening COVID-1942 Chinese Clinical Trial identifier, ChiCTR2000029757	103 participants with laboratory-confirmed COVID-19 that was severe (respiratory distress or hypoxemia) or life-threatening (shock, organ failure, or requiring mechanical ventilation)	Convalescent plasma in addition to standard treatment vs standard treatment alone (control)	Convalescent plasma therapy did not result in a statistically significant improvement in time to clinical improvement within 28 d.	Open-label. Trial terminated early after 103 of a planned 200 patients were enrolled. Trial likely underpowered.
Study to evaluate the safety and antiviral activity of remdesivir (GS-5734) in participants with severe Coronavirus Disease. ClinicalTrials.gov identifier, NCT04292899	397 patients hospitalized with COVID-19 with oxygen saturation ≤94% while breathing ambient air, and radiologic evidence of pneumonia	Patients were randomly assigned in a 1:1 ratio to receive intravenous remdesivir for either 5 d or 10 d	No difference between a 5-d course and a 10-d course of remdesivir.	Open label. Lack of a randomized placebo control group.
Dexamethasone in Hospitalized Patients with Covid-19 – Preliminary Report43 Randomized Evaluation of COVID-19 Therapy (RECOVERY). ClinicalTrials.gov Identifier, NCT04381936	6425 patients hospitalized with COVID-19	Oral or intravenous dexamethasone (6 mg once daily) for up to 10 d or usual care alone	The use of dexamethasone resulted in lower 28-d mortality among those who were receiving either invasive mechanical ventilation or oxygen alone at randomization but not among those receiving no respiratory support.	Open-label. Heterogeneity of the treatment effect with benefit in patients who were receiving respiratory support and no benefit (with potential harm) in patients who did not require oxygen.

COVID-19 = Coronavirus Disease 2019; SARS-CoV-2 = severe acute respiratory syndrome coronavirus 2.

We propose that efficient coordination could have readily identified gaps in evidence, candidate hypotheses, and interventions to be tested, consequently engaging international stakeholders in a cooperative effort that could lead to high-grade clinical evidence. Moreover, COVID-19 represents a condition where well-designed RCTs should have been quick to deliver due to the availability of patients eligible to be enrolled and a high rate of critical outcomes that develop rapidly and early.^{47 , 48} Successful coordination could have been achieved by the WHO engaging complementarity among international institutions. Unfortunately, this ideal role has been denigrated and compromised due to the end of multilateralism, and also, admittedly, due to the many inefficiencies inherent in the processing of the WHO.^{49 , 50}

This lack of coordination among public institutions, countries, and scientists has led to an increase in ostensible “expert opinions” that are not supported by solid scientific evidence.⁵¹ To deal with these issues, the International Coalition of Medicines Regulatory Authorities emphasized the need and commitment by global regulators to cooperate and align their approaches to clinical trial management and pharmacovigilance.⁵² To achieve this goal, a wider coordination of the media, medical academicians, and journals is urgently required.

Media and the Propagation of Misinformation

Evidence-based medicine has been readily adopted as the best standard of practice in most parts of the globe over the last decades. However, multiple digital sources that lack editorial oversight or peer review have led to a point where evidence-based, “traditional” medicine and fabricated facts are, regretfully, treated similarly.^{53 , 54} With billions of individuals online every day, health misinformation can spread at a very rapid pace.^{55 , 56} Many times, the spread of misinformation is supported by governments and public institutions, which may not only harm the public but may also enhance scientific mistrust.^{55 , 57}

This rapid spread of viral misinformation renders it impossible for anyone to distinguish between scientifically valid facts and completely false claims that can jeopardize health and well-being, compromise public health measures, and ultimately, undermine society as a whole.^{55 , 58 , 59} Consequently, learning how to detect unsubstantiated medical news requires an important dose of critical thinking. The American Council on Science and Health has issued a list of “red flags” for facilitating the detection of the role of media and misinformation, taking into account the credibility of the journal, the use of exaggerated language, lack of appropriate methodology, and conclusions not supported by data.⁶⁰ These steps may be helpful if one has a strong background in scientific methodology, which, unfortunately, most readers lack. Consequently, we need a strong engagement of social media platforms for early detection, scrutiny, and limiting the spread of the role of media and viral misinformation.⁶¹ Fortunately, the rapid development of publicly available datasets and innovative methods that can rapidly cross-check facts and track misinformation (eg, deep learning algorithms, natural language processing-assisted data mining, social network analysis), can facilitate the early detection of misinformation and be used for flagging users or groups that are contributing to the misinformation of the public.⁶² Although the scientific community generally still enjoys relatively high levels of public trust, disturbingly, 1 in 5 individuals express skepticism about scientists. These realities mandate that the medical community vet health misinformation on social media.^{54 , 63} Potential solutions to achieve this goal are delineated in Table 4 .

Table 4.

Potential Solutions to Increase the Quality of Randomized Trials and Information Diffusion

Problem	Potential Solution
Observational and RCT findings are given the same consideration/weight by the media and many scientists	-Medical journals should diffuse in the media the differences between an observational study and an RCT; -A grading of evidence (eg, “GRADE”) should be used along with the release of the study so that people can evaluate to what extent they should rely on the information; -Observational studies should generate hypotheses to be tested in RCTs and not inform about treatment decisions.
RCTs (to date) are underpowered for assessing mortality and have many methodological caveats	-Coordination is warranted to allocate resources for performing larger and well-powered studies; -The WHO should be able to provide such coordination and multilateral approach by liaising with the coordinating agencies and the Country/Union level (eg, EMA, NIH); -Independent DSMB should have the final decision on whether the trial should be stopped or not, and also inform about potential trial misconduct.
Exaggerated claims about efficacy are presented in the study conclusions and abstract	-Reviewers and journal editors should pay much attention to the wording and any suggestion of exaggerated effect, particularly in the abstract, which is the most widely read part of the article.
Spread of “fake news”	-Social media platforms should improve their systems of “fake news” detection using real-time algorithms that can cross-check information, providing a grading on how reliable that information is. An easy-to-implement color code could be used, with “green” = reliable, “yellow” = needs confirmation, “red” = unreliable/false; -Media in general should be more informed about the conduct of medical research and the grade of evidence, while complying with the ethical principles of journalism.*

DMSD = data monitoring and safety board; EMA = European Medicines Agency; “GRADE” = grading quality of evidence and strength of recommendations; NIH = National Institutes of Health; RCT = randomized controlled trial; WHO = World Health Organization.

GRADE Working Group (https://www.bmj.com/content/328/7454/1490).

^⁎https://www.spj.org/ethicscode.asp.

The current crisis has clearly revealed the worrisome lack of understanding by the general public, lay media, decision-makers, and politicians of the basics of the hierarchy of evidence. It is hoped that this crisis will contribute to an enhanced awareness about how medicine should transition from empirical-based practice to evidence-based practice. Education of the general public and political leaders about the simple but critical principles of clinical evidence generation is urgently required.⁶⁴ To facilitate this goal, an easy-to-follow color grading scheme for presenting medical evidence by the media and general public is presented in the Figure .

Figure.

Color-code proposal for grading evidence on medical news in the media (including social media). The color-code fact check would appear as a bar or logo on top of the shared messages. RCT = randomized controlled trial.

A search for the best available evidence should constitute a mainstay of society, but to achieve this goal, a large-scale and global coordination is required, for which participation by medical faculty and journals is essential.

A Pivotal Role for Academic Medical Faculties and Journals Is Mandatory

In many countries, including Canada and the United States, medical faculties maintain close community relationships that provide communication platforms to counteract media-driven disinformation. Consequently, responsible journalism, along with the public, benefits from close and vibrant relationships with local medical faculties. This 2-way communication (local medical faculty to the public, and vice-versa) must be regarded as an essential responsibility for our academic medical institutions to counteract the impact of misinformation.

Scientific journals must also have active engagement in proactively counteracting misinformation. Despite often being perceived as inaccessible to the lay public, many scientific journals have more recently embraced the need to translate knowledge more broadly; for example, by adopting open-access “patient pages” or brief summaries of the major research findings, often in the form of a “central illustration.” Most journals now have digital media tools and promote their articles in social media. Furthermore, many journals work in close alliance with medical societies and patient associations. We believe these elements serve collectively to position medical journals as potentially powerful agents, capable of mitigating and counteracting medical misinformation.⁵³ An increased involvement of the editors of medical journals, and the scientific community in general, is absolutely essential to help the public navigate a world rife with health-related misinformation.^{59 , 63}

Medical journals could play a leading role in achieving global consensus and prompting action on matters of public interest. Similar to the publication of guidelines for the treatment of specific conditions, and reporting of observational studies or RCTs checklists, medical journals should provide guidance and help regulate medical misinformation by enabling real-time fact-checking prior to the dissemination of medical information in the media (Figure).

Another innovation that medical journals should consider is to publish “theme issues” of global health interest (eg, vaccination, climate change, or cardiovascular prevention). Such “theme issues” can then be readily disseminated widely in the media, utilizing several outlets in a coordinated manner.

A social media strategy of Twitter promotion may increase the online visibility of research papers and also increase the number of citations.⁶⁵ Discussions are currently underway on whether Twitter should be used for continuous medical education.⁶⁶ While a social media-based strategy can be utilized to promote good-quality research, it cannot and absolutely should not replace research itself. Moreover, the constant outpouring of information creates too many information inputs and options, and having too many options may be as bad as having none.⁶⁷

A central issue that must be resolved is how medical journals will relate and coordinate with social media. Social media platforms are here to stay, but we must accept that they can be easily misused, prompting researchers to attempt to attain immediate recognition and feedback on Twitter as a substitute for engaging in years of rigorous research. Clearly, the value of a scientist should not be measured according to social media feedback, but rather by the quality and rigor of his/her research. To facilitate this evaluation, the scientific impact should be measured by long-term achievements rather than by short-term metrics. Instead of using metrics like Altmetric (London, UK), which aggregates short-term social media (eg, Twitter, Facebook, and other sources) outputs and displays, providing a composite score for each paper, medical journals should preferably deploy more long-term based metrics (eg, citation indexes and clinical utility) that value work product over time.^{55 , 68}

Another important and glaring issue that we perceive as despicable, that disrupts reliable data acquisition, is “publication by press release.” Private companies, governments, and research institutes are convening news conferences to report “potential breakthroughs” that cannot be verified because the complete dataset on which the announcements are based have not been peer reviewed.^{69 , 70} A recent example is Moderna's (Cambridge, Mass) claim of “favorable” results from its vaccine trial, which was regrettably announced in the absence of supporting underlying data.⁶⁹ Nonetheless, the announcement may have had its desired effect, that is, it successfully added billions of dollars to the value of the company in a single day.⁷¹

To summarize, medical journals must play a pivotal role in reducing the incentive for “publication by press release” by restricting publication of results that have been previously presented to the media in the absence of supporting robust data. As an acceptable alternative, we propose that medical journals can simultaneously provide “fast-track” peer review and publications with a simultaneous press release. Furthermore, scientific journal editors must exercise more oversight and stricter publication control, dedicating themselves to publishing only a limited number of articles per edition that are rigorous, data driven, and focused.

Our proposal for achieving a more central role for medical journals and editors in retaining transparency and quality of evidence is detailed in Table 5 .

Table 5.

The Central Role of Medical Journals and Editors for Retaining Transparency and Quality of Evidence

Proposed Role of Medical Journals and Editors
•Powerful agents for counteracting medical misinformation
•Should join forces to achieve global consensus and take action on matters of public interest
•Could provide guidance and regulation for information diffusion in the media
•Social media platforms (eg, Twitter) can be used to diffuse medical information (upon further regulation – see also Table 3 & the Figure), but they should by no means replace a full, thoroughly reviewed work
•Reward systems should place more emphasis on long-term scientific achievements, rather than immediate online rewards
•Clinical impact metrics should be created. For example, by conducting surveys with clinicians from a certain area of expertise to gather information on how much they used a research article for their clinical practice
•Medical journals should reduce incentives on publications by “press release.” For example, publications that have been previously presented in media without robust data should no longer be considered suitable for publication in a medical journal

Conclusions

The COVID-19 outbreak has exposed major gaps and serious flaws, both within the scientific world and in how scientific information is disseminated in a technological world of “immediate information.” The lack of coordination between countries and institutions, in concert with the feverish haste of publishing, has regretfully led to a massive output of small studies, observational data, and poor-quality RCTs. We propose a wide array of discrete “next steps” to correct these deficiencies. International organizations such as the WHO, and medical journals must be rendered accountable and tasked to play a significant role in the coordination and quality control of scientific output. Simultaneously, a permanent and clearly identified fact-check system should be adopted by the media, clearly identifying to the reader what is misleading or false and what is likely true. To facilitate these goals, we have constructed a novel and user-friendly grading template for enhancing presentation of medical evidence by the media and general public.