Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Jun 8;18(6):e0286908. doi: 10.1371/journal.pone.0286908

Conflict of interest in the peer review process: A survey of peer review reports

Adham Makarem 1,2, Rayan Mroué 1, Halima Makarem 3, Laura Diab 1, Bashar Hassan 1,4, Joanne Khabsa 5, Elie A Akl 6,7,*
Editor: Fares Alahdab8
PMCID: PMC10249818  PMID: 37289790

Abstract

Objectives

To assess the extent to which peer reviewers and journals editors address study funding and authors’ conflicts of interests (COI). Also, we aimed to assess the extent to which peer reviewers and journals editors reported and commented on their own or each other’s COI.

Study design and methods

We conducted a systematic survey of original studies published in open access peer reviewed journals that publish their peer review reports. Using REDCap, we collected data in duplicate and independently from journals’ websites and articles’ peer review reports.

Results

We included a sample of original studies (N = 144) and a second one of randomized clinical trials (N = 115) RCTs. In both samples, and for the majority of studies, reviewers reported absence of COI (70% and 66%), while substantive percentages of reviewers did not report on COI (28% and 30%) and only small percentages reported any COI (2% and 4%). For both samples, none of the editors whose names were publicly posted reported on COI. The percentages of peer reviewers commenting on the study funding, authors’ COI, editors’ COI, or their own COI ranged between 0 and 2% in either one of the two samples. 25% and 7% of editors respectively in the two samples commented on study funding, while none commented on authors’ COI, peer reviewers’ COI, or their own COI. The percentages of authors commenting in their response letters on the study funding, peer reviewers’ COI, editors’ COI, or their own COI ranged between 0 and 3% in either one of the two samples.

Conclusion

The percentages of peer reviewers and journals editors who addressed study funding and authors’ COI and were extremely low. In addition, peer reviewers and journal editors rarely reported their own COI, or commented on their own or on each other’s COI.

Introduction

We recently proposed the following definition of conflict of interest (COI): “A conflict of interest exists when a past, current, or expected interest creates a significant risk of inappropriately influencing an individual’s judgment, decision, or action when carrying out a specific duty.” [1]. COI may involve a broad spectrum of interests. The financial interests are the most obvious. For example, a researcher may receive significant financial rewards from a pharmaceutical company with interest in the findings of their research. Such financial COIs are common among members of clinical guidelines panels [2, 3]. There is evidence that the quality of the research as well as guidelines may be negatively affected [4].

Non-financial interests can also affect the integrity of research. Such interests include career advancement, fame, social interests, and intellectual beliefs [5]. For instance, an editor may be conflicted when peer reviewing a colleague’s work. Intellectual COI is another type of non-financial COI discussed as far as two decades ago [6]. Lately, intellectual COI has been increasingly acknowledged [7] particularly in clinical practice guidelines (CPG) development [8, 9]. It has been defined as ‘‘academic activities that create the potential for an attachment to a specific point of view that could unduly affect an individual’s judgment about a specific recommendation” [10].

Researchers are expected to avoid and minimize COIs, and disclose them when they exist. The International Committee of Medical Journal Editors (ICMJE) has developed a specific and unified form for disclosure of COIs to facilitate and standardize authors’ disclosures. Moreover, there are recommendations on how to manage and declare COIs among authors of clinical practice [11].

Peer reviewers and editors of journals play a key role in assessing and publishing research manuscripts [12]. On one hand, they need to assess the COI of authors and the funding source of the study. On the other hand, journal peer reviewers and editors may have their own conflict of interests that need to be disclosed [13].

In the current era, the standard for scientific publishing is to have research findings evaluated and published through a peer review process [14]. Peer-reviewed biomedical journals are publishing enormous number of articles each year. As of 2012, about 28000 scholarly journals published more than 2 million peer-reviewed articles [15]. An optimal scientific peer review process is essential to maintain the integrity of the scientific research and to support evidence-based practice.

There is increased media attention to the reported conflicts and concerns about the impact of industry-sponsorship [16, 17]. A transparent handling of conflicts of interest is essential for the public trust in the scientific process and the credibility of peer-reviewed published articles [5]. The reporting of authors’ disclosure of conflicts of interest in publications has become the standard [13]. In order to facilitate and standardize the process of authors’ disclosures, the International Council of Medical Journal Editors (ICMJE) has developed a form for the disclosure of COI [5]. The authors are required to declare via this form all financial and non-financial benefits or personal relationships that might bias their work.

COI issues are relevant to all participants in the peer-reviewed publication process–including peer reviewers, editors, and the editorial board members of the journals. The peer reviewers’ role is to critically assess the manuscript, by constructively commenting on the scientific work, and suggesting how to improve it [18]. Moreover, peer-reviewers and editors are expected to reflect and comment on the authors’ disclosures of conflicts of interest. There are questions about the effectiveness of the current system of COI disclosures. A randomized controlled study found that providing journal reviewers with authors’ conflict of interest information had no significant effect on their rating of the quality of the manuscript [19].

Similarly, journal editors have a core role in managing the review process, through assessing the peer reviewers’ reports and making the final decision on acceptance for publication. In addition, editors can significantly impact the integrity, quality and fairness of the peer review process by how they select the peer reviewers and managing any misconducts by authors or reviewers [20]. In fact, an analysis of the Open Payments database found that journal editors commonly accept industry payments which are often large [21]. Some journals have established policies to deal with editors’ COI [22]. Editors are also expected to review and consider the authors’ disclosures of conflict of interest as part of the peer review process. However, this aspect of their role has not been studied yet.

According to the ICMJE, peer reviewers and editors have to disclose their own conflicts of interest [5]. In some cases, those invited to peer review and editors may need to rescue themselves from being involved. Little is known about the practices and policies of journals regarding disclosures of conflict of interest among peer-reviewers and editors to public [13]. A study assessing the COI policies of health policy and services journals, found only one that described how the COIs of the editorial team are managed during the editorial process [23].

The objective of this study was to assess the extent to which peer reviewers and journal editors address authors’ conflicts of interests and study funding. Also, we aimed to assess the extent to which peer reviewers and journals editors reported and commented on their own or each other’s COI.

Methods

We included two samples in this study. First, we included a sample with any type of original research. However, we found that a very low percentage (9%) had at least one author reporting presence of COI. Given this would not allow us achieve the study objective, we decided to collect a second sample restricted to randomized controlled trials (RCTs) as a survey had found that more than half of clinical trials had authors reporting presence of COI [24].

Eligibility criteria

We included journals that publish in the field of Medicine and in English, are indexed in Medline, and publish all their peer review reports. We included only original articles that are peer reviewed.

Selecting reports

We used the Directory of Open Access Journals (DOAJ) as an initial list of journals. Then, we filtered the journals by language (English) and subject (Medicine). Then, we selected our samples according to the eligibility criteria. For our first sample, we included the latest two original publications from each journal that had peer review reports. For our second sample, we included the latest two randomized controlled trials (RCTs) that had peer review reports. Teams of two reviewers implemented the selection process in duplicate and independently. They resolved any disagreements through discussion, or with the help of a third reviewer if needed.

Data abstraction

We collected and managed study data using the Research Electronic Data Capture (REDCap) tool hosted at the American University of Beirut [25]. REDCap is a secure, web-based software platform designed to support data capture for research studies [25]. We also developed detailed instructions. After conducting calibration exercises, teams of two reviewers abstracted data in duplicate and independently. They resolved any disagreements through discussion, or with the help of a third reviewer if needed.

We abstracted the following data:

  • Characteristics of the journal (including impact factor, field of study, publisher)

  • Characteristics of the publication (primary research vs. systematic review; source of funding)

  • Whether the authors reported their COI and the study funding source

  • Whether the peer reviewers commented on authors’ COI and the study funding source

  • Whether the journal editors commented on authors’ COI and the study funding source

  • Whether the peer reviewers reported their own COI

  • Whether the journal editors reported their own COI

  • Whether authors and editors commented on the peer reviewers’ COI

  • Whether authors and peer reviewers commented on the editors’ COI

Whenever a COI was reported, we further categorized it according to a framework that we recently published [1]. The framework includes seven types of interests relating to either the individuals (direct financial benefit, benefit through professional status, intellectual, and personal) or their institution (direct financial benefit to the institution, benefit through increasing services provided by the institution, and nonfinancial).

Data analysis

We exported all data from REDCap to an Excel sheet for data cleaning and consistency checks. We are sharing that Excel sheet to make all raw data available (see S1 Appendix). We conducted quantitative descriptive analyses of all variables. We used percentage for categorical variables and median and interquartile range for continuous variables. We also conducted a thematic analysis of comments extracted.

Results

Search results

Fig 1 shows the selection process for the 2 samples included in this study. From the initial list of 150 open peer reviewed journals identified from the DOAJ, we included 72 journals meeting our eligibility criteria.

Fig 1. The selection process for the 2 samples included in this study.

Fig 1

For our first sample, we included 144 articles, two from each of the 72 eligible journals. For our second sample, 58 journals were eligible and published randomized controlled trials. One of these journals published only one RCT. Consequently, we included a total of 115 articles.

General characteristics

Table 1 presents the general characteristics of the journals included in the two samples. For both samples, the majority of journal were from the clinical field (80% and 83%), were published in BioMed Central (BMC) (85% and 89%), and were indexed in Medline (97% and 100%). For the majority of journals peer review was by invitation (99% and 98%), was conducted pre-publication (90% and 91%), and did not reveal the identity of the peer reviewers (56% and 64%).

Table 1. General characteristics of the included journals.

Sample 1 (N = 72) 1 Sample 2 (N = 58) 1
n (%) n (%)
Impact factor Med = 2.674 Med = 2.652
IQR = [2.28–3.27] IQR = [2.28–3.26]
Field*
    Basic sciences 34 (47) 29 (50)
    Clinical 57 (80) 48 (83)
    Public Health 41 (57) 31 (53)
    Health systems and policy 23 (32) 17 (29)
    Other 4 (5) 2 8 (14) 3
Publisher
    Taylor & Francis 4 (6) 4 (7)
    BioMed Central (BMC) 61 (85) 52 (89)
    Other 7 (9) 4 2 (4) 5
Journal indexed in Medline 70 (97) 58 (100)
Peer review only by invitation process
    No (open participation) 0 (0) 0 (0)
    Yes (invitation needed) 71 (99) 57 (98)
    Not reported 1 (1) 1 (2)
Peer review report:
    Pre-publication review 65 (90) 53 (91)
    Post-publication review 7 (10) 5 (9)
Open identity of peer reviewer 32 (44) 21 (36)

*Total does not add up to 100 due to overlap

1 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

2 n = 2: Computational and Biotechnologies; n = 1: Biomedical; n = 1: Translational

3 n = 3: Research Methodologies; n = 2: monitoring and computational modeling; n = 1: Health information technology; n = 1: Health financing and Economics; n = 1: Medical Education and Training

4 n = 1: Springer; n = 1: Oxford University Press; n = 1: Cambridge University Press; n = 1: BMJ Publishing Group; n = 1: Association for Medical Education in Europe (AMEE); n = 1: Wellcome; n = 1:Physiopedia

5 n = 1: Springer; n = 1: Wellcome

Table 2 presents the general characteristics of publications included in the two samples. The percentages of RCTs were 3% for sample 1 and 100% for sample 2. For both samples small percentages had COVID-19 as topic (8% and 3%), the median number of authors was 6, the majority had their first author primarily affiliated with academia (87% and 93%), and the majority had the first author affiliated with a high-income country (63% and 61%).

Table 2. General characteristics of the included publications.

Sample 1 (N = 144) 6 Sample 2 (N = 115) 6
n (%) n (%)
Type of research:
    Randomized controlled trials (RCTs) 5 (3) 115 (100)
    Non-randomized studies 64 (45) 0 (0)
    qualitative 18 (13) 0 (0)
    survey 5 (3) 0 (0)
    systematic reviews 13 (9) 0 (0)
    case reports 17 (12) 0 (0)
    Other: 22 (15) 0 (0)
COVID 19 topic 11 (8) 2 (3)
Number of authors Med = 6, IQR = [4–8] Med = 6, IQR = [5–10]
First author’s primary affiliation:
    Academic 125 (87) 107 (93)
    Governmental 8 (6) 4 (3)
    Intergovernmental 0 (0) 0 (0)
    Not for profit organization, other than academic 6 (4) 3 (3)
    Private for profit 5 (3) 1 (1)
    Other 0 (0) 0 (0)
Classification of the affiliated country of the first author:
    High income 90 (63) 70 (61)
    Upper-middle income 33 (23) 17 (15)
    Lower-middle income 15 (10) 23 (20)
    Low income 6 (4) 5 (4)

6 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

Table 3 presents characteristics of the peer review process. For both samples, the median for number of rounds of peer review, and the number of rounds of revision, and the number of peer reviewers was 2. In the two samples, the median of the number of editors involved was 1. Only 11% and 13% of editors’ letters to the authors were posted publicly, and of those 63% and 53% respectively provided the name of the editor.

Table 3. Characteristics of the peer review process.

Sample 1 (N = 144) 7 Sample 2 (N = 115) 7
Number of rounds of peer review Med = 2, IQR = [1–2] Med = 2, IQR = [1 –– 2]
Number of rounds of revision Med = 2, IQR = [2–4] Med = 2, IQR = [2–3]
Number of peer reviewers, per study Med = 2, IQR = [2–2.25] Med = 2, IQR = [2–2]
Number of reviewers, total 330 263
Peer reviewers identified by name 180 (55) 8 146 (56) 8
Number of editors involved, per study Med = 1, IQR = [1–1] Med = 1, IQR = [1–1]
Public posting of editors’ letter to the authors 16 (11) 9 15 (13) 9
Editor identified by name 10 (63) 10 8 (53) 10

7 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

8 denominator is the total number of reviewers: /330 in sample 1 and /263 in sample 2

9 denominator is the number of editors involved: /144 in sample 1 and /115 in sample 2

10 denominator is the number of editors who publicly posted letters to the authors: /16 in sample 1 and /15 in sample 2

Funding of the study

Table 4 presents the characteristics of funding of the included studies. For both samples, the majority of studies were reported as funded (67%and 90%) and included a statement on the funder’s role (57% and 59%). The top two sources of funding were governmental (61% and 46%) and internal funding (41% and 46%).

Table 4. Funding of the included studies.

Sample 1 (N = 144) 11 Sample 2 (N = 115) 11
n (%) n (%)
Funding status
    Not funded 38 (26) 9 (8)
    Funded 97 (67) 103 (90)
    Not reported 9 (7) 3 (2)
Reported Source(s) of Funding N = 97 * N = 103 *
    Internally funded 40 (41) 47 (46)
    Governmental 59 (61) 47 (46)
    Private for Profit 11 (11) 16 (16)
    Private not for Profit 19 (20) 22 (21)
    Intergovernmental 12 (12) 8 (8)
    Academic 14 (14) 8 (8)
Statement of the funder’s role 55/97 (57) 61/103 (59)

*Total does not add up to 100 due to overlap

11 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

Declaration of conflict of interest by authors, peer reviewers, and editors

Table 5 summarizes the declaration of conflict of interest by authors, peer reviewers, and editors. For both samples, the majority of studies had all authors report the absence of COI (89% and 68%). For both samples, the majority of studies had reviewers identified by name (55% and 56%), reported absence of COI (70% and 66%). For both samples, none of the editors whose names were publicly posted reported on COI. Substantive percentages did not report on COI of reviewers (28% and 30%) while only small percentages reported any COI (2% and 4%). Most of these declarations reported individual financial interests with direct financial benefit (see footnotes in Table 5 for more details).

Table 5. Declaration of conflict of interest of authors, peer reviewers, and editors.

Sample 1 12 Sample 2 12
Authors reporting of COI N = 144 N = 115
    Reports absence of COI 129 (89) 79 (68)
    Reports presence of COI (at least 1) 13 (9) 34 (30)
    Does not report on COI 2 (2) 2 (2)
Peer reviewers’ reporting of COI N = 330 N = 263
    Reports absence of COI 232 (70) 175 (66)
    Reports COI 7 (2) 13 9 (4) 14
    Does not report on COI 91 (28) 79 (30)
Editor’s reporting of COI N = 16 N = 15
    Reports COI 0 (0) 0 (0)
    Reports absence of COI 0 (0) 0 (0)
    Does not report on COI 16 (100) 15 (100)

12 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

13 4/7 had Individual financial interests with direct financial benefit, 2/7 had Individual personal interests, 1/7 had Individual intellectual interests.

14 6/9 had Individual financial interests with direct financial benefit, 3/9 had Individual personal interests.

Commenting on declarations of conflict of interest

Table 6 summarizes the extent of authors, peer reviewers and editors commenting on study funding and conflicts of Interest. The percentages of peer reviewers commenting on the study funding, authors’ COI, editors’ COI, or their own COI ranged between 0 and 2% in either one of the two samples. 25% and 7% of editors respectively in the two samples commented on study funding, while none commented on authors’ COI, peer reviewers’ COI, or their own COI. The percentages of authors commenting in their response letters on the study funding, peer reviewers’ COI, editors’ COI, or their own COI ranged between 0 and 3% in either one of the two samples. Fig 2 below illustrates these results among our 2 samples.

Table 6. Commenting on study funding and conflicts of interest by authors, peer reviewers and editors.

Sample 1 15 Sample 2 15
Authors (comments in their response letters) N = 144 N = 115
    Authors commenting on study funding 5 (3) 1 (1)
    Authors commenting on peer reviewers’ COI 0 (0) 0 (0)
    Authors commenting on the editors’ COI 0 (0) 16 0 (0) 17
    Authors commenting on their own COI 2 (2) 0 (0)
Peer reviewers N = 330 N = 263
    Peer reviewer commenting on study funding 1 (1) 4 (2)
    Peer reviewer commenting on authors’ COI 3 (1) 2 (1)
    Peer reviewer commenting on their own COI 2 (1) 1 (1)
    Peer reviewer commenting on editors’ COI 0 (0) 0 (0)
Editors N = 16 N = 15
    Editor commenting on study funding 4 (25) 1 (7)
    Editor commenting on author’s COI 0 (0) 0 (0)
    Editor commenting on their own COI 0 (0) 0 (0)
    Editor commenting on peer reviewers’ COI 0 (0) 0 (0)

15 sample 1 includes articles of any type of original research. Sample 2 is restricted to only randomized controlled trials (RCTs)

16 Denominator is the number of editors who had their letters posted publicly for the authors: /16 in sample 1

17 Denominator is the number of editors who had their letters posted publicly for the authors: /15 in sample 2

Fig 2. Commenting on own and other’s COI by authors, peer reviewers, and editors.

Fig 2

Discussion

Summary of findings

In summary, the percentages of peer reviewers and editors commenting on study funding and authors’ COI were extremely low. In addition, peer reviewers and journal editors rarely reported their own COI, or commented on their own COI, or on each other’s COI.

Strengths and limitations

To our knowledge, this is one of the first studies that examines the extent to which peer reviewers and editors consider study funding and authors’ COI, and the extent to which they report on their own COI. To ensure our findings are informative, we went beyond our original plan and included a second sample that involved a higher percentage of articles whose authors reported presence of COI, compared with our first sample. We found consistent results for the two samples. One limitation of this study is that our samples represent the peer review processes of articles that ended up being accepted for publication, but not of those that were not survive the peer review process or those that were published in non-open peer review journal.

Comparison to similar studies

The percentage of articles with at least one author reporting presence of COI for our first sample was only 9%. This percentage is much lower compared to that of systematic reviews (41%) and clinical trials (57%) [24, 26]. For our second sample, the percentage was higher at 30% because we included only randomized clinical trials. On the second hand, an article by Ralph et al. highlighted the fact that while there are concerns about authors’ financial COI in health research, there is little discussion on potential editorial financial COI [27]. In their sample of 20 public health journals, editor and peer reviewer financial COI policies were lacking strict disclosure requirements compared to author financial COI policies [27]. Moreover, another cross-sectional study of high-impact medical specialty journals found that although 99% of those journals required author’s COI disclosure, only 12% required editorial’s COI disclosure [28]. A review of the COI policies of 72 health policy and services journals found that only one policy described how the COIs of the editorial team are managed during the editorial process [23].

Implications for practice and research

The results of our study provide insight about the COI disclosure of peer reviewers, authors and editors. One important question is whether the findings are explained by the lack of relevant journal policy or by the non-compliance of editors with such a policy. Reviews of the COI policies of journals in the clinical, surgical and public health areas did not address how the COIs of the editorial team are managed during the editorial process, raising the need for further exploration [2931].

Our findings may help journals to develop policies to improve how COI is declared and managed during their editorial processes. It would be relevant to conduct qualitative research to explore why some peer reviewers and editors are commenting on authors’ COI and on the study funding and others are not. Such study may help in developing strategies to improve COI declaration and management during the peer review process. Also, it would be important to conduct a similar study of articles that underwent the peer review process but did not survive the peer review process or of articles that were published in non-open peer review journal.

Supporting information

S1 Appendix

(CSV)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Akl E.A., et al., A framework is proposed for defining, categorizing, and assessing conflicts of interest in health research. Journal of Clinical Epidemiology, 2022. 149: p. 236–243. doi: 10.1016/j.jclinepi.2022.06.001 [DOI] [PubMed] [Google Scholar]
  • 2.Mendelson T.B., et al., Conflicts of interest in cardiovascular clinical practice guidelines. Arch Intern Med, 2011. 171(6): p. 577–84. doi: 10.1001/archinternmed.2011.96 [DOI] [PubMed] [Google Scholar]
  • 3.Neuman J., et al., Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study. BMJ, 2011. 343: p. d5621. doi: 10.1136/bmj.d5621 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Cosgrove L., et al., Conflicts of interest and the quality of recommendations in clinical guidelines. J Eval Clin Pract, 2013. 19(4): p. 674–81. doi: 10.1111/jep.12016 [DOI] [PubMed] [Google Scholar]
  • 5.Editors, I.C.o.M.J., Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. 2018. [PubMed] [Google Scholar]
  • 6.Marshall E., When does intellectual passion become conflict of interest? Science, 1992. 257(5070): p. 620–3. doi: 10.1126/science.1496373 [DOI] [PubMed] [Google Scholar]
  • 7.Levinsky N.G., Nonfinancial conflicts of interest in research. N Engl J Med, 2002. 347(10): p. 759–61. doi: 10.1056/NEJMsb020853 [DOI] [PubMed] [Google Scholar]
  • 8.Lederer E.D., Development of clinical practice guidelines: are we defining the issues too narrowly? Clin J Am Soc Nephrol, 2007. 2(2): p. 207. doi: 10.2215/CJN.04471206 [DOI] [PubMed] [Google Scholar]
  • 9.Detsky A.S., Sources of bias for authors of clinical practice guidelines. CMAJ, 2006. 175(9): p. 1033, 1035. doi: 10.1503/cmaj.061181 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Guyatt G., et al., The vexing problem of guidelines and conflict of interest: a potential solution. Ann Intern Med, 2010. 152(11): p. 738–41. doi: 10.7326/0003-4819-152-11-201006010-00254 [DOI] [PubMed] [Google Scholar]
  • 11.Lo B. and Field M.J., Institute of Medicine (US) Committee on Conflict of Interest in Medical Research, Education, and Practice, eds.(2009): Conflict of Interest in Medical Research, Education, and Practice. Washington (DC): National Academies Press (US). www.ncbi.nlm.nih.gov …. [PubMed] [Google Scholar]
  • 12.Glonti K., et al., A scoping review on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals. BMC Med, 2019. 17(1): p. 118. doi: 10.1186/s12916-019-1347-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Cooper R.J., et al., Conflict of Interest Disclosure Policies and Practices in Peer-reviewed Biomedical Journals . J Gen Intern Med, 2006. 21(12): p. 1248–52. doi: 10.1111/j.1525-1497.2006.00598.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Davis C.H., et al., Reviewing the review: a qualitative assessment of the peer review process in surgical journals. Res Integr Peer Rev, 2018. 3: p. 4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Manchikanti L., et al., Medical journal peer review: Process and bias. Pain Physician, 2015. 18(1): p. E1. [PubMed] [Google Scholar]
  • 16.Davidoff F., et al., [Sponsorship, authorship and accountability]. Tidsskr Nor Laegeforen, 2001. 121(21): p. 2531–2. [PubMed] [Google Scholar]
  • 17.Fontanarosa P.B., Flanagin A., and DeAngelis C.D., Reporting conflicts of interest, financial aspects of research, and role of sponsors in funded studies. JAMA, 2005. 294(1): p. 110–1. doi: 10.1001/jama.294.1.110 [DOI] [PubMed] [Google Scholar]
  • 18.Evans A.T., et al., The characteristics of peer reviewers who produce good-quality reviews. Journal of general internal medicine, 1993. 8(8): p. 422–428. doi: 10.1007/BF02599618 [DOI] [PubMed] [Google Scholar]
  • 19.John L.K., et al., Effect of revealing authors’ conflicts of interests in peer review: randomized controlled trial. bmj, 2019. 367: p. l5896. doi: 10.1136/bmj.l5896 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Resnik D.B. and Elmore S.A., Ensuring the quality, fairness, and integrity of journal peer review: A possible role of editors. Science and Engineering Ethics, 2016. 22(1): p. 169–188. doi: 10.1007/s11948-015-9625-5 [DOI] [PubMed] [Google Scholar]
  • 21.Liu J.J., et al., Payments by US pharmaceutical and medical device manufacturers to US medical journal editors: retrospective observational study. bmj, 2017. 359. doi: 10.1136/bmj.j4619 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Gottlieb J.D. and Bressler N.M., How should journals handle the conflict of interest of their editors?: who watches the “watchers”? Jama, 2017. 317(17): p. 1757–1758. [DOI] [PubMed] [Google Scholar]
  • 23.Khamis A.M., et al., Requirements of health policy and services journals for authors to disclose financial and non-financial conflicts of interest: a cross-sectional study. Health Res Policy Syst, 2017. 15(1): p. 80. doi: 10.1186/s12961-017-0244-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hakoum M.B., et al., Authors of clinical trials reported individual and financial conflicts of interest more frequently than institutional and nonfinancial ones: a methodological survey. Journal of clinical epidemiology, 2017. 87: p. 78–86. doi: 10.1016/j.jclinepi.2017.04.002 [DOI] [PubMed] [Google Scholar]
  • 25.Harris P.A., et al., The REDCap consortium: building an international community of software platform partners. Journal of biomedical informatics, 2019. 95: p. 103208. doi: 10.1016/j.jbi.2019.103208 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hakoum M.B., et al., Reporting of financial and non-financial conflicts of interest by authors of systematic reviews: a methodological survey. BMJ open, 2016. 6(8): p. e011997. doi: 10.1136/bmjopen-2016-011997 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Ralph A., Petticrew M., and Hutchings A., Editor and peer reviewer financial conflict of interest policies in public health journals. European Journal of Public Health, 2020. 30(6): p. 1230–1232. doi: 10.1093/eurpub/ckaa183 [DOI] [PubMed] [Google Scholar]
  • 28.Dal-Ré R., Caplan A.L., and Marusic A., Editors’ and authors’ individual conflicts of interest disclosure and journal transparency. A cross-sectional study of high-impact medical specialty journals. BMJ Open, 2019. 9(7): p. e029796. doi: 10.1136/bmjopen-2019-029796 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Shawwa K., et al., Requirements of clinical journals for authors’ disclosure of financial and non-financial conflicts of interest: a cross sectional study. PLoS One, 2016. 11(3): p. e0152301. doi: 10.1371/journal.pone.0152301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.El Moheb M., et al., The policies for the disclosure of funding and conflict of interest in surgery journals: a cross-sectional survey . World Journal of Surgery, 2021. 45: p. 97–108. doi: 10.1007/s00268-020-05771-0 [DOI] [PubMed] [Google Scholar]
  • 31.Daou K.N., et al., Public health journals’ requirements for authors to disclose funding and conflicts of interest: a cross-sectional study. BMC public health, 2018. 18: p. 1–9. doi: 10.1186/s12889-018-5456-z [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Fares Alahdab

7 Mar 2023

PONE-D-22-27587Conflict of Interest in the Peer Review Process: A Survey of Peer Review ReportsPLOS ONE

Dear Dr. Akl,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

ACADEMIC EDITOR:This is a very interesting study on an important topic. I commend the authors for their work and urge them to revise the manuscript in light of the comments we received from the reviewers on this. Apologies for the delay in making our decision; we had some difficulties in receiving meaningful reviews from external experts on this submission after having invited a large number of potential reviewers.

Please submit your revised manuscript by Apr 06 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Fares Alahdab

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

********** 

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

********** 

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

Reviewer #4: Yes

********** 

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

********** 

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The very subject of this paper challenges the peer reviewer to be scrupulous and meticulous in their review. The PLOS peer review process asks me to justify my responses to 4 specific questions.

1. I find the survey approach taken, and the adjustments made, to be appropriate to the question. The authors discuss the limitations of their sample but this is a consequence of issues beyond their control. The conclusions reached are appropriate.

2. The statistical analysis is straightforward, appears to be correctly undertaken and is informative.

3. The authors declare that they have made all the underlying data available, much of it is in the manuscript.

4. The manuscript is clear and easy to follow and written in standard English.

Additional comments

This paper is a salutary reminder of the full extent of our responsibilities as researchers, reviewers and publishers. The research community has come along way in requiring declarations of conflicts of interests from primary researchers, but we clearly have some way to go with how we review this information - saying we have made a declaration should not be enough in itself - but this paper shows us that for the majority of peer reviewers and editors it is - there is not enough checking and alerting the readers of COI going on.

I thought the authors did a good job of presenting their findings in a factual, non-judgmental fashion - they could have said more about the potential implications, but I think they have made the right choice, it is not difficult for the reader to see where these findings lead.

There were some interesting findings that it would have been interesting to hear more about, for example, more on "intellectual COI" and how routinely that is declared. Also, another interesting snippet was that the majority of authors in the papers sampled came from high income countries. Perhaps the acknowledged gap in analysis of papers rejected would tell us more. And finally, across all samples, only one editor used in the peer review process and no COI declared - there are some real lessons for us all in this paper.

Reviewer #2: This is a very important study. Please add an explanation before publication.

Please explain a little bit more about Research Electric Data Capture (REDCap)? I do not understand your description " We developed data extraction form using the Research Electronic Data Capture (REDCap) tool hosted at the American University of Beirut. We also developed detailed instructions. After conducting calibration exercises, teams of two reviewers abstracted data in duplicate and independently. They resolved any disagreements through discussion, or with the help of a third reviewer if needed."

Would you explain the process in detail? Is REDCap validated?

Also, the readers cannot access the system and check the data reproducibility?

Reviewer #3: The manuscript is a technically sound research and the presented data support the conclusions reached. The sampling and sample size are adequate, statistical analyses done are simple but adequately serves the purpose of the research. All the data in the result section were adequately presented. The language of the manuscript is simple and clear, with no grammatical error noted

Reviewer #4: 1. An important theme. Will indeed be relevant towards improving reporting of COI. I have a number of comments seeking clarification and making statements clearer. Please see my comments embedded in the manuscript.

2. It appears that a number of facets of COI reporting in relation to the three key constituencies - authors, reviewers, and editors - and presented in various tables in this manuscript need to be seen in the view of the editorial/journal policies and/or guidelines for authors /submission guidelines. I have tried to indicate such aspects and spots/places in the manuscript as indicative ones in the attached file (the manuscript with my review comments).

3. In this regard, it may mean to present some analysis of the journal policy/submission guidelines/guidelines for authors' of the journals included in this review study. This would help readers to know if many journal simply do not have policy documents that require authors, reviewers and editors to declare their COIs, or if it is to do with the implementation gap, that is, policies are in place but are not implemented with required diligence and rigor at the editorial offices. Suggestion to include such a section. If there might be constraints to present such an analysis, it certainly requires presentation of some insights from the existing scholarship in this area.

3. Under 'What is new?', it says, "This is one of the first studies that examines ... on their own COI." ( p no 4 and later in the submission). However, the basis of such a statement/claim is somewhat unclear as the section '4.3.Comparison to similar studies' compared study findings with some of the existing literature. A more fine tuned an nuance articulation would be more appropriate to keep it close to both the objectives of this review and more importantly findings of the review.

4. It is not clear and not explained as why only two recent papers have selected from each of the journals included in the pool from where the papers are retrieved and included in this review. Please state it explicitly, unless I missed it. As well, it is not adequately as what parameters/criteria employed to determine which two recent papers to be included from many recent papers.

5. Similarly, the rationale for Sample 2, is somewhat weak on two counts: one, the authors might have already undertaken some work to decide on the scope of journals/type of articles to be included in this review for COIs etc; two, it is said that a paper (ref no 25 in the manuscript) led the authors to include RCTs as Sample 2. Both appear to be somewhat ad hoc rationales, especially the latter. Will be helpful and will be needed to present more robust rationale for sample 2. Readers would expect a rationale that is more informed and well-thought which might be the case. However, the current articulation seems like it was 'by chance'.

6. Please you may ignore highlighters in the attached file with my embedded review comments.

********** 

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr Safia Qureshi

Reviewer #2: No

Reviewer #3: Yes: Oluwatoyin Aduke Babalola

Reviewer #4: Yes: Dr Sunita Sheel Bandewar

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-22-27587_reviewer_Ss Comments_2Feb23.pdf

Decision Letter 1

Fares Alahdab

26 May 2023

Conflict of Interest in the Peer Review Process: A Survey of Peer Review Reports

PONE-D-22-27587R1

Dear Dr. Akl,

I am pleased to see that the issues and areas of concern have been thoroughly and adequately addressed, resulting in an improved manuscript. We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Fares Alahdab, MD, MSc

Academic Editor

PLOS ONE

Acceptance letter

Fares Alahdab

30 May 2023

PONE-D-22-27587R1

Conflict of Interest in the Peer Review Process: A Survey of Peer Review Reports

Dear Dr. Akl:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Fares Alahdab

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix

    (CSV)

    Attachment

    Submitted filename: PONE-D-22-27587_reviewer_Ss Comments_2Feb23.pdf

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES