Skip to main content
Clinical and Translational Gastroenterology logoLink to Clinical and Translational Gastroenterology
editorial
. 2022 Jan 11;13(1):e00443. doi: 10.14309/ctg.0000000000000443

Double-Blind Reviews: A Step Toward Eliminating Unconscious Bias

Eugenia Shmidt 1,✉, Brian C Jacobson 2,✉
PMCID: PMC8806370  PMID: 35130182

Starting in January 2022, we are excited to announce that Clinical and Translational Gastroenterology (CTG) will transition from a single-blind to a double-blind peer review system.

The peer review process, wherein scholarly work is scrutinized by experts before publication, serves as the foundation of medical advancement. At CTG, we believe that balanced, thoughtful, and fair peer reviews constitute the backbone of our Journal's scientific rigor.

Like most peer-reviewed journals, CTG heretofore used a single-blind review system, in which the reviewers' identity is unknown to the authors, but the authors' identity was known to the reviewers. With double-blind reviewing, neither the authors' nor reviewers' identities are shared. Historically, arguments against double-blind review claim that successful blinding is cumbersome, and it precludes comprehensive assessment of a manuscript and its authors. Proponents of double-blind review suggest that it is a more impartial process that limits biases and results in higher quality peer reviews.

Biases based on investigators' reputations, institutional prestige, race, and/or sex—whether conscious or not—permeate the scientific community. Research comparing single-blind with double-blind reviews has shown that the perceived author and institutional prestige are associated with increased rates of manuscript acceptance (1,2). Sex-biased and racial biases have been demonstrated in various scientific enterprises and likely impact peer reviews as well. Indeed, research from CTG Associate Editor, Dr. Violeta Popov, has shown that female authorship in gastroenterology journals lags behind the percentage of women practicing in the field of gastroenterology (3). Although this does not prove causality, any steps taken to remove potential biases bring us closer to a more accurate assessment of the science presented in submitted manuscripts. We anticipate that double-blind reviews will help mitigate the biases that exist in the scientific press. These sentiments are supported by a study of 40,000 research paper authors in which double-blind review was considered the most effective form of peer review (4). Moreover, evidence suggests double-blind reviews are of higher quality than single-blind reviews (5).

At CTG, we queried our community of authors and reviewers regarding their preference for a single- or double-blind review process. With 88% author and 80% reviewer response rates, nearly 65% of respondents signaled their support for double-blind reviews (in near equal distribution between reviewers and authors). Fewer than 10% of respondents disfavored double-blind reviews.

We recognize that a double-blind review process is an imperfect system. Unintentional exposure of author or institution identity is sometimes unavoidable, such as in small, specialized fields or subsequent to early sharing of data at conferences. Successful blinding of author identity is achieved approximately 60% of the time (6,7) and may be increased to 75% with the removal of identifying allusions and self-citations (8).

Starting in January 2022, identities of authors' names and institutions will be withheld from reviewers. The authors will be instructed to avoid first person self-referencing and allusions to affiliations as much as possible. Title pages with author and institutional information will be uploaded as an individual document, separate from the remainder of the manuscript. This will facilitate blinding of manuscripts sent for external expert review.

We acknowledge this may impose an additional burden on both authors and CTG staff. However, given the support we have heard from our authors and reviewers, we feel the benefits justify these efforts.

The CTG Editorial Board is proud of our dedication to promoting diversity, equity, and inclusion. Our decision to adopt a double-blind review process reflects our deep commitment to decreasing bias whenever possible. We realize there will be challenges because no system is perfect, but we also look forward to bringing those challenges to light and systematically addressing them in a transparent fashion. In this spirit, we will be self-monitoring the success of our efforts and welcoming feedback from authors, reviewers, and readers.

CONFLICTS OF INTEREST

Guarantors of the article: Eugenia Shmidt, MD and Brian C. Jacobson, MD, MPH, FACG.

Specific author contributions: Both authors contributted equally.

Financial support: None to report.

Potential competing interests: Both authors are editors for Clinical and Translational Gastroenterology.

Supplementary Material

SUPPLEMENTARY MATERIAL
ct9-13-e00443-s001.docx (213.1KB, docx)
Download video file (14.7MB, mp4)

REFERENCES

  • 1.Okike K, Hug KT, Kocher MS, et al. Single-blind vs double-blind peer review in the setting of author prestige. JAMA 2016;316(12):1315–6. [DOI] [PubMed] [Google Scholar]
  • 2.Tomkins A, Zhang M, Heavlin WD. Reviewer bias in single- versus double-blind peer review. Proc Natl Acad Sci USA 2017;114(48):12708–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ou A, Lin E, Pavri T, et al. Breaking the academic ceiling: Gender disparities and bias in authorship in leading gastroenterological journals. Am J Gastroenterol 2019;114(Suppl):S650. [Google Scholar]
  • 4.Mulligan A, Hall L, Raphael E. Peer review in a changing world: An international study measuring the attitudes of researchers. J Am Soc Inf Sci Technol 2013;64(1):132–61. [Google Scholar]
  • 5.McNutt RA, Evans AT, Fletcher RH, et al. The effects of blinding on the quality of peer review. A randomized trial. JAMA 1990;263(10):1371–6. [PubMed] [Google Scholar]
  • 6.Fisher M, Friedman SB, Strauss B. The effects of blinding on acceptance of research papers by peer review. JAMA 1994;272(2):143–6. Erratum in: JAMA 1994;272(15):1170. [PubMed] [Google Scholar]
  • 7.van Rooyen S, Godlee F, Evans S, et al. Effect of blinding and unmasking on the quality of peer review: A randomized trial. JAMA 1998;280(3):234–7. [DOI] [PubMed] [Google Scholar]
  • 8.Snodgrass R. Single-versus double-blind reviewing: An analysis of the literature. ACM Sigmod Rec 2008;35:8–21. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

SUPPLEMENTARY MATERIAL
ct9-13-e00443-s001.docx (213.1KB, docx)
Download video file (14.7MB, mp4)

Articles from Clinical and Translational Gastroenterology are provided here courtesy of American College of Gastroenterology

RESOURCES