Introduction
Scientific progress, including in evidence-based medicine, requires all available evidence to be accessed, scrutinised, interpreted and used. Missing or incomplete evidence creates biases and errors in later research. Open science practices are movements and procedures that aim to increase transparency in science production. They aim to make scientific knowledge available, accessible and reusable, benefitting scientific collaboration and all society.1 Open access is a core component of open science that aims to help solve the problem of accessibility.2
Traditional publication behind a paywall can hide evidence from the public, clinicians, policymakers and other researchers. Whether online or print, traditional scientific journals maintain their content behind a paywall, with only abstracts freely available to read.3 Readers access articles by purchasing the individual article, the entire journal issue or through a subscription. These journal subscriptions are purchased by institutions like universities and libraries. However, readers whose institutions cannot afford these subscriptions or who are not affiliated to an institution are often unable to pay to access every article they need. Members of the public and readers in low-resourced countries are disproportionately affected.4
Open access is defined as making a document freely available for anyone to read and, depending on the licence model, share and use (Box 1). Scholarly publishers now offer open access routes for publishing journal articles such as protocols, commentaries, reviews and result articles. The academic community expects these publishers to adhere to the same quality standards as in traditional closed access publication, such as peer review, indexing and permanent archiving. Biomedical research has progressively adopted open access, with yearly increases in the percentage of articles available as open access publications and the number of countries and policies mandating open access.5 6 Online supplemental text 1 summarises national and international open access mandates.
Box 1. Summary of open access journal publication.
What—Open-access journal publications are scientific articles freely available for anyone to read and, depending on the model, share and use.
Why—Open access makes knowledge available for all, not only those who can afford to pay to read articles or subscribe to journals. Open access is a core component of open science.
When—Some countries now mandate open access for publicly funded health research. However, this is not yet possible in many lower income countries due to open access costs.
Who—Every part of the science ecosystem has a role in making open science publishing possible: governments, funders, research institutions, publishers, educators and researchers.
How—Increasing the proportion of open access articles to allow more people to read involves reducing or eliminating the barriers to the publishing system that authors face, either through funding more general diamond open access venues in a sustainable way, supporting open access fees payments more widely, or both.
bmjebm-2022-112126supp001.pdf (243.1KB, pdf)
Open access has the potential to solve the problem of accessibility. It benefits the final users of the evidence produced, who are patients and healthcare professionals in the case of evidence-based medicine. It also benefits researchers, who can avoid waste from reproducing investigations unnecessarily or having to reinvent procedures that are not clearly explained. To help authors to decide whether to choose open access and how, we summarise the main benefits of open access, the routes for open access and their challenges.
Benefits of open access publication of health research
The right to access research
As previously mentioned, the problem of inaccessible research disproportionately affects certain groups and countries. Knowledge produced by health research can be thought of as a public good.7 8 Much biomedical research is funded by public money, such as taxes or charitable donations. Yet members of the public are often unable to access the results of research without paying access fees. The main beneficiary of open access publication is the reader who can freely access, read, use and benefit from research.9 Eliminating paywalls is the first step towards more equitable knowledge-sharing However, who is responsible for ensuring publication occurs without a paywall is something currently under debate.8
Reproducibility
Open access publications can facilitate reproducibility and replicability of research. Readers of open access journal articles can view the full research description and any links to repositories where data, code or materials are deposited.10 Replicating results independently validate the evidence generated.11 12
Innovation
Wide access to knowledge is essential for research progress.6 When research findings and associated methods and materials are available, they can be used, tested and critically appraised, becoming the building blocks to inspire or support new scientific discoveries.11 12
Reducing waste
Open access can prevent unnecessary duplication of studies, especially in low-resourced areas and small businesses that might not have access to journal subscriptions.9 13 14
Influence on policy
Open access helps ensure stakeholders can view the full range of research, including results that disagree with expectations held by researchers or others. As a result, patients, advocacy groups, policymakers and politicians can make better-informed decisions and future public resources are less likely to be wasted on interventions that do not work.9 13 Widespread open access can also help mitigate against fraud by opening published information to scrutiny.13
Limitations of open access
Open access cannot solve methodological or ethical problems in completed research or publications. It can only make these issues visible and possible to scrutinise, allowing cases of misconduct and fraud to be more easily and openly identified and discussed. Being accessible is not a synonym of good science, even if it is open science.
Open access does not solve poor or incomplete reporting. Fully accessible papers can still lack the minimum information considered necessary to judge the validity of the work.
Routes for open access: benefits and challenges
Authors can choose between several open access routes that have developed within and outside the existing publishing system. Author choice might be dictated by personal choice, funder requirements, institution requirements, national mandates, and journal options.
Open access outside scholarly publishing
Authors can make their work available to all separately from a peer-reviewed publication. For example, they can register a study on an open platform and share their plans and results.15 They can share search strategies, code, images and datasets in appropriate repositories. They can deposit whole manuscripts on open preprint platforms to seek feedback before submitting to journals or while waiting for peer review.16 They can also publish informally using blog posts and other outputs. These outlets allow authors to share much of their work openly on searchable platforms. Authors should consider how to help readers find everything they need. For example, they might use one platform to share all stages of the work, rather than fragmenting the work across multiple platforms.
However, if the research report is not published also in a scholarly journal, it will not have passed through the quality control step of peer review and may not be trusted by readers. If the article is also published, any mismatch between the published manuscript and alternative output can prevent reproducibility if both documents are not publicly available. For example, blog posts and other informal documents usually do not include the method details that publications supply. Mismatches are common in preprints, as peer review improves the publication and preprints are often not updated to reflect the changes. Open access publication of research in a scholarly venue can make these differences clear.
Open access within scholarly publication
Table 1 compares some of the most common open access models used in scholarly publication. Some of these models have proven challenging for publishing or academic communities, especially regarding sustainability, ownership, governance and legal responsibilities.6 Sherpa Services summarises the models offered by individual journals and funder requirements.17
Table 1.
Publication models of research articles
| Model/feature | Traditional (subscription) | Bronze open access | Green open access | Gold open access | Diamond open access |
| Publication charges | The author is charged nothing.* | The author is charged nothing.* | The author is charged nothing.* | The author is charged an article processing charge (APC). | The author is charged nothing. |
| Copyright licence | The author usually transfers their copyright to the publisher or grants the publisher an exclusive right to publish. The article is published under full copyright, all rights reserved. | The author usually transfers their copyright to the publisher or grants the publisher an exclusive right to publish. The article is published under full copyright, all rights reserved. | The author usually transfers their copyright for the final version to the publisher or grants them an exclusive right to publish. The author retains copyright of an earlier version (post-print or author-accepted manuscript) and can often choose copyright licence that it can be made available under (usually Creative Commons+). |
The author retains their copyright. They choose the copyright licence that the article is published under (usually Creative Commons+). | The author retains their copyright. They choose the copyright licence that the article is published under (usually Creative Commons+). |
| Reading the article | The article is published behind a paywall. The publisher sells access to the whole journal for a subscription fee. Readers can separately buy access to single articles. | The whole journal is behind a paywall. The publisher sells access to the whole journal for a subscription fee. However, this article is available for anyone to read for free, without a subscription. | The article is published behind a paywall, as in traditional publication. The author can self-archive the author-accepted version on a personal website and/or institutional repository and make it free to read after a certain amount of time has passed since formal publication (the embargo period). |
Anyone can read the article for free. | Anyone can read the article for free. |
| Copying, sharing and using the article (reuse options) | No reuse allowed without a separate agreement. | No reuse allowed without a separate agreement. | No reuse of the published version allowed without a separate agreement. Some reuse of the self-archived version may be allowed, depending on the Creative Commons+ licence chosen by the author or repository. |
Some reuse may be allowed, depending on the Creative Commons+ licence chosen by the author or repository. | Some reuse may be allowed, depending on the Creative Commons+ licence chosen by the author or repository. |
Some journals offer authors a choice of models. For instance, some hybrid journals allow traditional and gold open access.
*Many journals without article processing charges do charge for colour figures or pages beyond a limit.
†For information about Creative Commons licences, please see table 2.
Regardless of the model they use, commercial publishers and not-for-profit organisations supporting journal publishing must ensure the published articles meet minimum editorial quality standards.6 13 Online supplemental table 1 summarises the main administrative and editorial services needed. They include much more than managing peer review. For example, publishers must ensure that correct, sufficiently detailed metadata are applied to research articles, so that they can be found, stored and shared.18 Services related to tagging and indexing require best practices in XML marking for machine readability.5 19 The availability of accurate metadata on research papers is crucial for open science18 but can be a challenge for less-resourced publishing and repository communities.19 Monitoring how meta-data are applied is essential for evaluating how open access is implemented.20
bmjebm-2022-112126supp002.pdf (208.8KB, pdf)
The traditional model of publication recovers the costs of providing these services through fees for reading, subscriptions and licencing the use of the materials in secondary outputs such as articles used for teaching and figures and tables reprinted in presentations and reviews. Subscriptions are the main source of revenue for traditional publishers.6 Many traditional publishers operating subscription-based models require authors to transfer their copyright or sign restrictive agreements (all rights reserved). Copyright protection ensures copyright owners benefit from the reproduction (right to copy) and dissemination of the article6 and prevent copying or reusing material without their permission. Readers wishing to reuse material under copyright must obtain permission and often pay a fee.21 In contrast, in most open access models, authors retain their copyright and waive certain rights using Creative Commons licences (table 2),22 allowing readers to share and reuse the work in set ways without additional permission. Publishers using open access models need to recoup at least some of their costs from elsewhere, balancing openness and reuse with publishers’ profits.6
Table 2.
Creative commons licences used to waive copyright
| Licence short name | Licence full name | Users may | Users must | Academic users |
| CC BY | Creative Commons Attribution | Share: copy and redistribute the material in any medium or format for any purpose, even commercially. Adapt: remix, transform, and build on the material for any purpose, even commercially |
Give appropriate credit, provide a link to the licence and indicate if changes were made | Readers can download articles, send electronic copies and print copies. Educators can use articles in teaching. Authors can use article contents in their articles. These uses do not require additional permission or payment, but credit must always be given |
| CC BY-SA | Creative Commons Attribution ShareAlike | Share: copy and redistribute the material in any medium or format for any purpose, even commercially. Adapt: remix, transform and build on the material for any purpose, even commercially |
Give appropriate credit, provide a link to the licence and indicate if changes were made. Distribute any remixed, transformed or built-upon material under the same licence as the original |
Readers can download articles, send electronic copies and print copies. Educators can use articles in teaching. Authors can use article contents in their articles. These uses do not require additional permission or payment, but credit must always be given and any materials (articles, teaching materials) must have the same licence |
| CC BY-ND | Creative Commons Attribution NoDerivatives | Share: copy and redistribute the material in any medium or format for any purpose, even commercially | Give appropriate credit, provide a link to the licence and indicate if changes were made. Not distribute any remixed, transformed or built-upon material |
Readers can download articles, send electronic copies and print copies. Educators can use articles in teaching but cannot reproduce elements within their materials. Authors and educators need additional permission and possible payment to use portions of the article in their new materials. Credit must always be given |
| CC BY-NC | Creative Commons Attribution NonCommerical | Share: copy and redistribute the material in any medium or format for non-commercial purposes Adapt: remix, transform and build on the material for non-commercial purposes |
Give appropriate credit, provide a link to the licence and indicate if changes were made. Not use the material for commercial purposes (not primarily intended for or directed towards commercial advantage or monetary compensation) |
Readers can download articles, send electronic copies and print copies for non-commercial uses, provided credit is given. Authors wishing to use elements of the work in new materials that are commercial (eg, book, journal article) require additional permission and possible payment |
| CC BY-NC-ND | Creative Commons Attribution NonCommerical NoDerivatives | Share: copy and redistribute the material in any medium or format for non-commercial purposes | Give appropriate credit, provide a link to the licence and indicate if changes were made. Not use the material for commercial purposes (primarily intended for or directed towards commercial advantage or monetary compensation) Not distribute any remixed, transformed, or built-upon material |
Readers can download articles, send electronic copies and print copies for non-commercial uses, provided credit is given. Any commercial use or distributing any derivative work (eg, using a figure in a review article) requires additional permission from the copyright holder and possible payment |
The licence descriptions in this table are adapted from the Creative Commons website (https://creativecommons.org/licenses), whose content is licenced under a Creative Commons Attribution 4.0 International license. Full licence descriptions22 are available on the Creative Commons site.
Gold open access: a popular model reinforcing inequity
The common gold open access model moves the burden of publishing costs onto authors.23 On acceptance, authors pay an article processing charge (APC) intended to cover the journal’s lifetime costs for the article, in exchange for immediate and perpetual open access. Journals often charge higher APCs for more permissive licences, as they will not benefit from future reuse payments. Funders that require the work they fund to be published open access will often cover these APCs.24
Although gold open access benefit readers, it exacerbates existing structural inequities14: only those who can afford it are able to publish their work in prestigious journals under the most permissive licences. Funding in low-income countries is barely adequate to cover research costs, let alone publishing fees.23 Although some publishers and journals have tried to alleviate this issue by offering discounts and waivers for corresponding authors from certain lower income countries, many countries are not eligible.25 These costs may not be justifiable, as the most prestigious journals tend to charge the highest APCs6 23 and a small group of large commercial publishers have profit margins exceeding 30%.6
Green open access: the administrative burden of repositories
Green open access avoids placing the burden of cost on authors by taking advantage of the existing traditional publishing system. Although the publisher controls the final formatted and copyedited manuscript version that is published, the author retains their copyright to an earlier version, usually the version accepted after peer review but before journal formatting is applied (author-accepted manuscript). Journals offering green open access allow the author to share this earlier version through an institutional or personal repository at a specified time after the final version is published.
The benefit of green open access is that it is free for authors and readers, and authors can allow reuse of their work through their choice of copyright licence. Authors are not blocked from publishing in a journal by their funder’s open access requirements or their ability to pay. However, the delay in the article becoming fully accessible is not always acceptable to authors or funders. Authors and their institutions incur an administrative cost in maintaining repositories, depositing articles and tracking embargo periods. There can also be discrepancies between the green open access version and the final copyedited published version, introducing error into the scientific record.
Diamond open access: a challenge in sustainability
Under diamond open access, articles are free to read and use without charges to readers or authors. Authors can find journals offering diamond open access using the Directory of Open Access Journals.26 These publications are usually run by a society, library or research institution that covers the publishing costs or by volunteers from within the academic area. They are often isolated journals or platforms, rather than part of a larger commercial publisher, and often only accept manuscripts from researchers from certain countries or work supported by particular funders or on certain topics.27 28 They are, therefore, not yet a solution to open access for all researchers.
The economic benefits of diamond open access to authors and readers are clear. However, there can be issues around sustainability. These journals rely on dedicated funding from organisations, which is not always guaranteed long term. However, they still need to provide high-quality editorial services and long-term archiving of their articles. Aspects of academic publishing that can challenge the diamond open access model are ownership, governance and legal responsibilities,27 as the cost for curation and preservation of archives can be high.13 PubMed Central offers long-term archiving of all indexed articles, which mitigates this risk for indexed journals.
Hybrid journals: a compromise for now
Hybrid journals allow authors to choose between traditional closed access publication and gold open access publication in the same journal. Authors without financial support can publish in hybrid journals without paying the APC, but their paper will be behind a paywall.6 Readers can access and use certain articles without charge, depending on whether authors paid APCs. However, institutions and libraries must continue to pay subscriptions to ensure access to the journal’s full content. This creates a double source of revenue6 that some consider to be unfairly profitable. As a result, the cOAlition S group of major European research funders do not support the hybrid model and view these journals as a transition tool that should be phased out.29
Bronze open access
Bronze open access refers to the practice of subscription journals, making selected articles ‘free to read’ while retaining their copyright privileges.6 Although similar to hybrid from readers’ perspective, bronze open access provides fewer benefits to readers because these free-to-read articles remain under restrictive copyright, so cannot be shared or reused.6 Library/institutional subscriptions are not affected. Authors are unable to choose between the free-to-read or pay-to-read option. As there is no agreement with the authors, journals can move these articles back to pay-to-read at any time.
Predatory publishers
Unscrupulous organisations have capitalised on the open access movement. They masquerade as scholarly publishers, soliciting APCs from authors. However, they do not adhere to any of the quality markers of scholarly publishing, such as robust peer review, indexing or archiving. A distinction should be drawn between these so-called predatory publishers, which have no interest in improving their processes or contributing to the evidence base, and publishers of low-quality journals or those that are starting out.30 31 Authors can avoid predatory journals by using the Think Check Submit32 checklist.
Conclusion
Open access has the potential to remove barriers to reading and using research. It is a necessary component of open and reproducible science, alongside sharing data, code and materials, but alone it is not enough to ensure research quality. Current models for open access have different benefits and burdens for authors, readers, funders, publishers and others, with no model meeting all needs. Authors’ choice of open access route is curtailed by funder, institution and other requirements, costs, and what their target journals offer. As open access develops, one of the challenges is to ensure that it reduces inequity and does not compound existing problems and inequalities.
Footnotes
@patlogullo, @GSCollins
Contributors: PL, JdB and GSC contributed with conceptualisation. JdB and PL contributed with the investigation. PL wrote the first draft of the manuscript. JdB, SK, MMS and GSC edited manuscript versions. All authors revised the last version submitted and are accountable for the work.
Funding: All authors were supported by Cancer Research UK (programme grant: C49297/A27294).
Competing interests: GC is the Editor-in-Chief of BMC Diagnostic & Prognostic Research, a Statistical Editor for the BMJ, and an Associate Editor for Research Integrity and Peer Review. PL is a member of the Editorial Board of Evidence-Based Toxicology and Cytopathology. MMS is in the Editorial Board of Operative Neurosurgery. SK is an associate member of the BJOG Editorial Board.
Provenance and peer review: Commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Not applicable.
References
- 1. Recommendation on open science [UNESCO]. Available: https://www.unesco.org/en/legal-affairs/recommendation-open-science [Accessed 2 Feb 2023].
- 2. UNESCO . Draft recommendation on open science - UNESCO Digital library. 2021. Available: https://unesdoc.unesco.org/ark:/48223/pf0000378841 [Accessed 04 Jan 2023].
- 3. Berlin declaration on open access to knowledge in the sciences and humanities. 2003. Available: https://openaccess.mpg.de/67605/berlin_declaration_engl.pdf [Accessed 05 Dec 2022].
- 4. Salager-Meyer F. Scientific publishing in developing countries: challenges for the future. J Engl Acad Purp 2008;7:121–32. 10.1016/j.jeap.2008.03.009 [DOI] [Google Scholar]
- 5. Liljekvist MS, Andresen K, Pommergaard HC, et al. For 481 BIOMEDICAL open access journals, articles are not searchable in the directory of open access journals nor in conventional biomedical databases. PeerJ 2015;3:e972. 10.7717/peerj.972 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. UKRI - UK Research and Innovation . Economic implications and benefits assessment of an updated UKRI open access policy for peer-reviewed research articles; 2020. 100.Available: https://www.ukri.org/wp-content/uploads/2021/08/UKRI-060821-EconomicImplicationsAndBenefitsAssessmentOfAnUpdatedUKRIOpenAccessPolicyForPeerReviewedResearchArticles-FINAL.pdf
- 7. Boulton G. Science as a global public good. International science council position paper. 2021. Available: https://council.science/wp-content/uploads/2020/06/ScienceAsAPublicGood-FINAL.pdf
- 8. Skre AB, Eide A. The human right to benefit from advances in science and promotion of openly accessible publications. Nord J Hum Rights 2013;31:427–53. 10.18261/ISSN1891-814X-2013-03-09 [DOI] [Google Scholar]
- 9. JISC . An introduction to open access. 2019. Available: https://www.jisc.ac.uk/guides/an-introduction-to-open-access [Accessed 05 Dec 2022].
- 10. Goodman SN, Fanelli D, Ioannidis JPA. What does research reproducibility mean Sci Transl Med 2016;8:341ps12. 10.1126/scitranslmed.aaf5027 [DOI] [PubMed] [Google Scholar]
- 11. Nosek BA, Alter G, Banks GC, et al. Promoting an open research culture. Science 2015;348:1422–5. 10.1126/science.aab2374 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. UKRI - UK Research and Innovation . Open research. Available: https://www.ukri.org/what-we-offer/supporting-healthy-research-and-innovation-culture/open-research/ [Accessed 02 Feb 2023].
- 13. Kroes N. Commission recommendation of 17 July 2012 on access to and preservation of scientific information. Off J Eur Union 2012;L 194:39–43. [Google Scholar]
- 14. Parikh S, Malcom SM, Moran B. Public access is not equal access. Science 2022;377:1361. 10.1126/science.ade8028 [DOI] [PubMed] [Google Scholar]
- 15. Cashin AG, Richards GC, DeVito NJ, et al. Registration of health and medical research. BMJ Evid Based Med 2023;28:68–72. 10.1136/bmjebm-2021-111836 [DOI] [PubMed] [Google Scholar]
- 16. DeVito NJ, Morton C, Cashin AG, et al. Sharing study materials in health and medical research. BMJ Evid Based Med 2023;28:255–9. 10.1136/bmjebm-2022-111987 [DOI] [PubMed] [Google Scholar]
- 17. Sherpa . Sherpa V3. Available: https://beta.sherpa.ac.uk/ [Accessed 28 Jun 2023].
- 18. Wilkinson MD, Dumontier M, Aalbersberg IJJ, et al. The FAIR guiding principles for scientific data management and stewardship. Sci Data 2016;3:160018. 10.1038/sdata.2016.18 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Brown J, Jones P, Meadows A, et al. Metadata to support the UKRI open access policy: landscape and community readiness analysis [UKRI]. 2022. Available: https://www.ukri.org/wp-content/uploads/2022/11/UKRI-301122-UKRI_Open-access_Metadata_final-report.pdf [Accessed 05 Dec 2022].
- 20. UKRI - UK Research and Innovation . Roadmap for the open access research information landscape. 2022. Available: https://www.ukri.org/publications/roadmap-for-the-open-access-research-information-landscape/ [Accessed 05 Dec 2022].
- 21. Logullo P, de Beyer JA, Kirtley S, et al. Reporting guidelines should be free to publish, read, and use. J Glob Health 2020;10:0203107. 10.7189/jogh.10.0203107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Creative Commons . About CC licenses [Creative Commons]. 2019. Available: https://creativecommons.org/about/cclicenses/ [Accessed 05 Jan 2023].
- 23. Pavan C, Barbosa MC. Article processing charge (APC) for publishing open access articles: the Brazilian scenario. Scientometrics 2018;117:805–23. 10.1007/s11192-018-2896-2 [DOI] [Google Scholar]
- 24. UKRI - UK Research and Innovation . Shaping our open access policy - implementing our open access policy. 2022. Available: https://www.ukri.org/what-we-offer/supporting-healthy-research-and-innovation-culture/open-research/open-access-policies-review/implementing-our-open-access-policy/ [Accessed 05 Dec 2022].
- 25. World Health Organization . Hinari access to research for health programme. 2021. Available: https://partnership.who.int/hinari [Accessed 05 Jan 2023].
- 26. Directory of open access journals – DOAJ. 2023. Available: https://doaj.org/ [Accessed 28 Jun 2023]. [DOI] [PMC free article] [PubMed]
- 27. DOAJ . Action plan for Diamond access [DOAJ News Service]. 2022. Available: https://zenodo.org/record/6282403#.Y7Wz-i2l1eg
- 28. Bosman J, Frantsvåg JE, Kramer B, et al. OA diamond journals study. Part 1: findings [Zenodo]. 2021. Available: https://zenodo.org/record/4558704 [Accessed 28 Jun 2023].
- 29. cOAlition S . Principles and Implementation | Plan S, Available: https://www.coalition-s.org/addendum-to-the-coalition-s-guidance-on-the-implementation-of-plan-s/principles-and-implementation/ [Accessed 24 Nov 2022].
- 30. Cukier S, Lalu M, Bryson GL, et al. Defining predatory journals and responding to the threat they pose: a modified Delphi consensus process. BMJ Open 2020;10:e035561. 10.1136/bmjopen-2019-035561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Grudniewicz A, Moher D, Cobey KD, et al. Predatory journals: no definition, no defence. Nature 2019;576:210–2. 10.1038/d41586-019-03759-y [DOI] [PubMed] [Google Scholar]
- 32. Think, Check, Submit . Identify trusted publishers for your research. Available: https://thinkchecksubmit.org/ [Accessed 28 Jun 2023].
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjebm-2022-112126supp001.pdf (243.1KB, pdf)
bmjebm-2022-112126supp002.pdf (208.8KB, pdf)
