Skip to main content
Western Journal of Emergency Medicine logoLink to Western Journal of Emergency Medicine
. 2026 Oct 21;27(6):1727–1734. doi: 10.5811/westjem.64401

Impact of a Mentored Peer-Review Program on the Sponsoring Journal: Program Evaluation at Five Years

Jeffrey N Love *,✉, David P Way †, Wendy C Coates ‡, Anne M Messman §, Chris Merritt ||, Douglas S Ander #, Jonathan S Ilgen
PMCID: PMC13761939  PMID: 43023770

Abstract

Introduction

The number of peer-reviewed biomedical journals has more than tripled over the past 20–25 years increasing the demand for quality peer reviewers. This demand and the lack of available formal training in peer review have resulted in a shortage of qualified peer reviewers. In response to this shortage, the Western Journal of Emergency Medicine Special Issue in Education (Special Issue) developed a formal mentored peer-review (MPR) program that provides a learning experience in peer review to educate fellows through legitimate participation while contributing to the editorial process of the journal. The latter serves as the basis of this study.

Methods

The impact of the MPR program on the Special Issue’s reviewer pool served as the primary outcome of this study. This was accomplished by tracking the number of participating fellowships and their graduates who subsequently provided independent peer reviews for the sponsoring journal. Comparisons of MPRs generated by education fellows and their fellowship directors to those generated by our nonmentored faculty reviewers served two secondary outcomes: the quality of peer reviews and time from peer review offer to submission of the requisite peer reviews.

Results

Over a period of five years, 82 fellows mentored by 43 fellowship directors submitted 147 MPRs. Of the 60 MPR graduates (35%), 21 were retained as independent peer reviewers. Based on a five-point editorial scoring scale (5 being excellent) mentored peer reviews received significantly higher editorial ratings (4.13 [SD 0.8]) than nonmentored faculty reviews (traditional reviewers) (3.33 [1.04]) and independent reviews by program graduates (3.61 [0.84]] (P < .001). We evaluated two peer-review turnaround periods. The first was the time from the initial two offers to review until two offers had been accepted. Instances where the first two offers were randomly made to MPRs were compared to offers to nonmentored faculty reviewers. The latter group took 60.2 (32.0) days compared to the MPR group, which averaged 17.2 (16.7) days (P < .001). The second interval measured the time from reviewer acceptance of the peer review until they submitted their completed review. There was no difference between the time in days between MPRs (10.4 [7.9]) and nonmentored faculty (9.4 [8.1]) in submitting reviews that had been accepted.

Conclusion

The mentored peer-review program contributed to increasing the Special Issue’s reviewer pool with reviews of higher quality. In addition, by inviting two mentored peer-reviewers initially as compared to nonmentored faculty reviewers, the time frame for obtaining two secured peer-reviewers was significantly reduced. These findings demonstrate that a formalized approach to learning peer review by partnering with academically oriented fellowships has the potential to improve the availability of peer reviewers, the quality of peer reviews, and efficiency in the editorial review process.

INTRODUCTION

Peer review is critical to the integrity of the scientific process by improving the quality of and curating the best possible submissions for publication. The number of journals in academic medicine has significantly increased over the years, demonstrating exponential growth in the digital age and further increasing the demand for peer reviews.1–3 This demand, along with the lack of available formal training in peer review, has resulted in an insufficient number of qualified peer reviewers available to meet the needs of many journals.4–9 The result is often substandard reviews and delays in editorial decision-making, which frustrates authors submitting their work for publication and limits the journal’s ability to publish important studies in a timely fashion.2,10–12

Many peer reviewers feel that they are ill-prepared for their roles.13–15 Engagement of established reviewers has been further confounded by the perceived time commitment required for activities that are largely unrecognized and unrewarded.15–19 Authors and journals have attempted to bridge this training gap by offering lectures, workshops, just-in-time resources, and published papers.16,20–23 Despite these efforts, journal editors continue to struggle with limited pools of qualified reviewers.10–12

To better prepare potential reviewers, there has been a call for more reliable processes to teach skills for performing peer reviews.13, 24–27 A number of authors have advocated for mentored peer reviews (MPR) as an effective approach to developing the knowledge and skills required to successfully fulfill this role.2,28–30 Preliminary reports from those who were coached or mentored through the peer review process have demonstrated mixed results. Two studies reported that participants generally enjoyed enhanced self-efficacy and a better understanding of research methodology but did not demonstrate improved peer review quality.28–30 One journal-based program recently reported outcomes based on a six-month curriculum that paired residents or fellows with experienced mentors. They reported via a preselected case-based study followed by mentorship that the quality of the postintervention mentee’s independent review of the same manuscript significantly improved over the mentee’s independent preintervention version.32 While some journals are willing to provide MPR opportunities to novice reviewers, formalized journal-based programs on a larger scale are uncommon. The need for additional administrative efforts, identifying qualified mentors, creating and validating a curriculum and establishing effective mentoring relationships tends to limit such efforts.29–34

Consistent with the Council of Residency Directors in Emergency Medicine’s mission to “Lead the advancement of emergency medicine education,”35 a partnership was formed with the Western Journal of Emergency Medicine to create an annual Special Issue in Educational Research and Practice (henceforth referred to as the “Special Issue”). In 2019, the editors of the Special Issue developed a curriculum for a novel, evidence-based MPR program using Kern’s six-step approach and an educational experience grounded in legitimate peripheral participation.36

Population Health Research Capsule.

What do we already know about this issue?

There is a shortage of peer reviewers available to journals, as well as a lack of effective learning opportunities for those who want to learn this skill.

What was the research question?

What is the impact of a journal-based mentored peer-review program (MPR) on the editorial process of that journal?

What was the major finding of the study?

The MPR program increased the reviewer pool by 54, provided significantly greater quality reviews [4.13(.82)/3.33(1.04)] (P < .001), and shortened turnaround time.

How does this improve population health?

Increasing the quality of medical education journals’ peer review process has the potential to improve medical education and, in turn, patient care.

Evaluating the impact of the MPR program on the Special Issue’s editorial process over its first five-year period was the objective of this study. We hypothesized a positive impact on the pool of available peer reviewers, as well as improved quality and turnaround time of the MPRs.

METHODS

This prospective, observational program evaluation employed a quasi-experimental design with nonequivalent groups to establish a clear temporal relationship between the intervention and its outcomes. The 2020–2024 annual Special Issues editorial process served as the basis for the outcomes reported. The George Washington Institutional Review Board approved this study as exempt (NCR202845). Informed consent was given, and participation was voluntary. Efforts were made to ensure that the data and privacy were properly protected and managed.

The MPR program engaged 35 emergency medicine (EM) education fellowships over the five-year course of this investigation. These fellowships focus on developing expertise in medical education, pedagogy, instructional design and/or medical education research. Emergency medicine education fellowships are of either one or two years in duration, with the latter being more likely to have a scholarly orientation.36 Of the participating programs, 34 of 35 (97.1%) offer a two-year fellowship, many including a master’s degree in education. The directors of these programs are highly qualified educators and researchers, whereas their fellows typically have little experience as authors or peer reviewers.36

Three groups made up the pool of reviewers that were compared in this study: our traditional nonmentored faculty reviewers (controls); MPRs from participating fellowships; and graduates of our MPR program who subsequently provided independent reviews. Once a manuscript passed administrative review and received approval for formal review, the opportunity to peer review was assigned on a random basis regardless of subject matter or complexity. When MPRs were selected, the corresponding fellowship director was sent an invitation to participate by the coordinating study author (JNL). If accepted, the fellow was listed as the reviewer on the journal website to blind the editors as to whether the review was an MPR or not.

Time to Secure Two Peer Reviewers Per Manuscript

The first period tracked was the time from the initial two offers to review until two reviewers had accepted the opportunity. The Special Issue’s standard was to allow potential reviewers two weeks to respond, with a reminder at one week. If no answer was received, another reviewer was selected. To compare nonmentored faculty reviewers to MPRs, we measured only those instances in which two nonmentored faculty or two MPRs received the initial offer. This approach was adopted as the most direct measurement of the impact of this time frame on the editorial turnaround time as well as to gain a better understanding of any delays that occurred. There were insufficient numbers of MPRs for this to occur randomly prior to 2023.

Turnaround Time for Reviews

The second interval was the time from when each accepting reviewer (controls or MPR) was provided access to the manuscript until the submission of the completed review. Completion of peer review was requested within two weeks of gaining access to the manuscript. Extensions were provided by decision editors as needed and were counted toward measurement of this metric. This period was tracked to determine whether the collaborative interaction expected from the MPR process and subsequent submission of the reviews by the fellow would prolong this phase of the editorial process. Since collaboration is not an issue for traditional reviewers or fellowship graduates providing independent reviews, the data from these two groups regarding completion of reviews were combined.

Review Quality

The quality of each submitted review was scored by one of two editors and one of eight section editors assigned to that manuscript. The final score for each review consisted of the mean of the editor’s and the section editor’s scores. Scoring was guided by the Special Issue’s holistic editorial scoring rubric, which uses a five-point scale with anchors for each point. As an abbreviated summary, a score of 5 represents a thorough review that could stand alone as an overall evaluation of a manuscript; 4, a review that contributes substantially to the formal decision-making; 3, meets the standard of an acceptable review by providing meaningful input to decision-making but is incomplete; 2, provides some insights but does not make a substantive contribution to decision-making; and 1, fails to provide any meaningful insights.37 Validity evidence supporting the use of this scale in the current population has previously been published.37

Editors were blinded to each other’s scores by submitting to a blinded third person.37 Overall review quality, as determined by mean scores and the percentage of reviews scoring greater than 4.0 (“gold standard reviews”), was compared among controls, MPR and MPR graduates. For the latter group, comparisons were made to provide an understanding of this cadre’s ability to provide quality independent peer reviews following graduation from their fellowship. The process by which MPR graduates were evaluated for the potential to serve as independent reviews upon graduation has previously been described.36

Data Analysis

When comparing controls, we analyzed MPR and MPR graduates scoring of review and turnaround times via t-test and the Levene test of equality of variances to assess whether the variances of two or more groups were equal. If a variance was found, Cohen d was applied as a standardized measure of the practical significance of the observed difference: 0–0.1 = no effect; 0.2–0.4 = small effect; 0.5–0.7 = intermediate effect; and greater than 0.8 = large effect. In addition, we tracked counts, frequencies, percentages and applied associated descriptive statistics related to demographics where appropriate.

Temporal Changes in Reviewer Pool Composition

The impact of the MPR program on the number available new reviewers was evaluated first by annually tracking the number of participating fellowship programs, MPRs, and fellowship graduates providing independent peer reviews. We also tracked the percentage of the total annual reviews represented by these groups.

RESULTS

Reviewer Pool Size

Over this five-year period, 43 fellowship directors served as mentors in the MPR program. This is more than the number of participating programs due to turnover in the fellowship director position. A review of the Special Issues published since its inception in 2014 reveals that only two of these mentors (4.7%) served in the role of independent peer reviews for this journal prior to their involvement in the program. Over the study period, 82 fellows participated in this study through one or more mentored peer reviews. Of the 60 fellowship graduates, 21 (35.0%) have gone on to provide independent peer reviews for this journal since graduating. Table 1 provides the annual number of MPRs and MPR graduates providing independent peer reviews, as well as their impact on the overall number of reviews and recognition as gold standard reviewers.

Table 1.

Indices regarding the impact of a mentored peer-review program on the editorial review process of the Special Issue in Educational Research and Practice over the five-year study period.

Issue year 2020 2021 2022 2023 2024
Education Fellowships 14 19 27 30 35
MPRs (% Total Reviews) 9.7% (16/165) 29.5% (38/129) 42.1% (32/83) 47.4% (27/57) 49.3% (34/69)
MPRs (% of All Gold Standard Reviews) 50.0% (10/20) 35.3% (6/17) 81.0% (17/21) 82.4% (14/17) 54.5% (12/22)
Graduates (Reviewers) 0 1 2 12 21
Graduates (% Total Reviews) 0.0% (0/165) 0.7% (1/129) 2.4% (2/83) 21.1% (12/57) 30.4% (21/69)
Graduates (% of Gold Standards Reviewers) 0.0% (0/20) 5.0% (1/17) 4.8% (1/21) 11.8% (2/17) 18.2% (4/22)

Graduates represent prior MPR participants providing independent peer review following graduation.

Gold standard review status is achieved by a blinded editor’s scoring of > 4.0 on a 1–5 scale ( 5 being excellent).

MPRs, mentored peer reviews by education fellows.

Review Quality

Editorial evaluation of review quality, based on the Special Issue’s holistic editorial scoring rubric of traditional, MPRs, and independent reviews of graduates, is reported in Table 2.

Table 2.

Comparison of editorial scoring of reviews (5 being exceptional) among controls’ peer reviews, mentored peer reviewers (MPRs), and graduates of the mentored-peer review program (based on their average editorial review rating.

Groups (n) Mean Review Score Std Deviation *S-N-K Post Hoc F ratio P value
Traditional (292) 3.33 1.04 61.243 < .001**
MPR Graduates (30) 3.61 0.84
MPRs (141) 4.13 0.82 a
Total (463) 463 1.03

There is a significant difference at the P < .001*, and the Levine test of equality of variances (effect size) was significant when comparing mentored peer reviews from the other two groups.

*

Cohen d measurement of variance effect size was intermediate to large (.7–.8). The Student-Newman-Keuls post hoc test indicated that the traditional and program graduates were statistically similar while MPRs were statistically differenta than both other groups at the P < .05 level.

MPRs, mentored peer reviews of fellows; MPR Graduates, independent reviews by previously participating fellowship graduates; S-N-K, Student-Newman-Keuls.

The Student—Newman—Keuls (post hoc test indicated that the MPR group reviews scored significantly higher in quality than did the other two groups (nonmentored faculty and MPR graduates). Furthermore, there was no difference between the quality scores of nonmentored faculty reviewers and those submitted by graduates of the MPR program. (Table 2)

Time to Secure Two Peer Reviewers

The first editorial period assessed was from the time when the first offers were made until two review opportunities were accepted in instances when the first two were MPRs versus two control reviewers were compared (Table 3).

Table 3.

Comparison between instances in which two traditional reviewers or two mentored peer reviewers (2023 and 2024) were the first two offers to review and tracking the turn-around time from initial peer-review requests to that point in time when two offers were accepted.

Reviewer Type Number of Manuscripts Mean Turn-around Time Days (+/−SD) t* P value** ES
Nonmentored faculty 17 60.2 (32.0) 4.95 < .001 1.70
MPRs 18 17.2 (16.7)
TOTAL 35 38.1 (33.1)
*

Because the Levene test for equality of variances was significant, equal variances between groups was not assumed; therefore, the smaller (adjusted) t-value and associated degrees of freedom were selected. The t-value adjusted for unequal variances was significant at the **P < .001 level. The Cohen d effect size for review ratings between MPRs and controls reviewers is considered very large.

ES, effect size; MPRs, mentored peer reviews; SD, standard deviation.

The difference between the means of the two groups was 43 days (P < .001). Issues that led to delays in obtaining two acceptances are highlighted in Figure. Note the number of “no answers” and “refusals” in comparing the two groups and the delays.

Figure.

Figure

Comparison of the times (days) and steps in obtaining two acceptances when the first two offers were nonmentored faculty versus two mentored peer-reviews (MPRs). The examples used were that instance in each group that came closest to that group’s mean time (nonmentored faculty, 57; and MPRs,15 days).

Turnaround Time for Reviews

After accepting the review, the next period tracked was from the time in days—from gaining access to the manuscript until the review was submitted to the journal. The mean turnaround time in days for controls (n = 305) was 9.4 (8.1) days versus 10.4 (7.9) days for MPRs (n = 138). There was no statistical difference between the two groups (P = .21).

DISCUSSION

The MPR program was initiated five years ago as a professional development opportunity for education fellows. Since that time, the program has had a significant effect on the Special Issue’s peer-review process by the increasing number of participating programs and their graduates who subsequently provide independent reviews. This growth continues to increase annually. Secondly, the participating MPR programs provided higher quality reviews than did our traditional nonmentored faculty. Finally, the MPRs had a shorter turnaround time of peer reviews, which facilitated timely editorial decision-making.

The impact of the MPR program on the growing number of peer reviewers is the result of several factors. First, the number of participating education fellowship programs grew from 14 to 35 programs over the five-year period since the program’s inception. A total of 41 fellowship directors recognized the value of this skill-development opportunity for their fellows and thus chose to participate in the Special Issue MPR program. This participation has resulted in a reliable cadre of high-quality reviewers for the Special Issue. Over the past three years, the MPRs have been responsible for nearly 50% of the peer reviews required by the Special Issue. Over this same period, the number of manuscript submissions decreased, limiting our ability to expand opportunities to interested fellowships or to fully realize the potential value of this initiative to participants and the journal. A second way in which the MPR program has contributed to the pool of peer reviewers is by offering graduates the opportunity to provide independent peer reviews on which they continue to receive feedback based on the decision editor’s summary and the second reviewer’s comments. The number of such reviewers has grown substantially and currently represents 35% of graduates. Based on this growth, MPR graduates who provide independent reviews appear to have the greatest potential to contribute to the long-term expansion of the reviewer pool.

The MPR program was developed as an experience for early-career scholars to promote skills related to peer review. Such experiences have the potential to be adopted by fellows and integrated into their own practices, further improving their knowledge and skills related to education scholarship.38 Over the past two years, six prior fellow mentees have stepped forward to serve as mentors in the MPR program, primarily as fellowship faculty. These observations suggest that this may well serve as a scaling factor that further contributes to the pool of trained peer reviewers over time.

Based on average review scores and the percentage of those who are recognized as gold standard reviewers, the quality of mentored peer reviews was significantly greater than that of our traditional reviewer pool (nonmentored faculty). This finding runs contrary to the findings of a previous MPR study in which the sponsoring journal paired new reviewers with high-functioning senior reviewers.33 The mentorship suggested by the sponsoring journal was to discuss the review with the mentees by “email or phone” followed by the mentor providing feedback to the mentee. After reviewing the literature, these authors hypothesized that the lack of improvement from this experience was likely due to an insufficiently focused and detailed mentoring process between individuals with no prior or ongoing relationships. Due to their prior training and experience in education and scholarship, education fellowship directors are likely a different group than our traditional faculty reviewers. Considering the novice status of most participating fellows in the MPR program,36 the quality of MPRs likely resulted from a substantive mentorship in the context of a longitudinal mentoring relationship integrated into fellowship training. An additional contributing factor may also include the collaborative approach of MPRs.

The quality of independent peer reviews by fellowship graduates was found to be equivalent to that of traditional reviewers. Considering participating fellows’ relative lack of experience upon beginning fellowship,36 this performance appears to reflect substantive growth in the fellows’ skills and knowledge related to education scholarship and peer review based on their fellowship experiences. For most, it is doubtful that two years of fellowship would prepare fresh graduates, one to two years out of training, to provide the same quality of peer review as those who were mentored by their fellowship director. This decline in quality based on editor scoring appears to reflect the loss of mentorship and perhaps also the opportunity to collaborate.

Authors consider multiple factors when choosing a journal for manuscript submission. These include journal reputation, impact factor, relevance of the topic, target audience, and timeliness of turnaround time from submission to final decision and publication.39,40 Although all are important, the latter is the one over which editors have the most direct control. Consequently, our finding that inviting two MPRs initially, as opposed to two traditional reviewers, reduced the time to obtain two accepted reviews by six weeks is potentially important. As demonstrated in Figure, the delays in recruiting traditional nonmentored peer reviewers versus MPRs was largely based on the number of “no responses” and “refusals.”

Consistent with our findings, a recently published preliminary report by a journal-based MPR program demonstrated a reduction in ignored and declined peer-review requests, thereby reducing turnaround times for reviews when comparing MPRs to traditional reviewers.12 This disparity is likely the result of the different values these two groups place on this experience. Nonmentored faculty reviewers have competing priorities that are often perceived as having a greater impact on their career, making it less likely that they accept an offer to review a manuscript.13–15,17–19 In contrast, we reported previously that fellows value MPRs as professional development opportunities and that fellowship directors see this as an important addition to the training they provide.36

Fellows generally have more time for a jointly performed exercise that supports their education, which may also be a contributing factor. However, once the opportunity to review was accepted, there was no difference between the two groups in the time to submit the completed review, thereby demonstrating a commitment to the task at hand by both groups once they had committed to the review.

LIMITATIONS

The Special Issue accepts submission types in all standard educational categories (original research, educational advances, reviews, and scholarly perspectives). As submissions were randomly assigned to peer reviewers, there is always some risk of unequal distribution of manuscript types. Although this limitation should be kept in mind, it appears that the higher quality reviews of MPRs scale to more complex studies and manuscript types.

Although blinding of the editor’s score occurred by having the fellow listed on the website, there was potential for the editors to identify the fellows and nonmentored faculty reviewers. The medical education community in EM is such that it is not uncommon to recognize the names of other faculty members and learners from prior teaching/mentoring experiences. This raises the potential for bias based on the recognition of both nonmentored faculty reviewers and fellows involved in mentored peer reviews. It is also possible that the editor who participated in inviting fellowship directors, traditional reviewers, and graduates to review could have recognized submitting reviewers. Blinding of the review scores by the section editor and the guest editor was intended to mitigate such bias.

The success and thus generalizability of this journal-based program is largely dependent on integrating this experience into the curriculum of a specialty fellowship related to scholarship. This educational environment set the stage for quality mentorship and significant motivation of mentors/mentees. The absence of educational support, in this case provided by fellowships, is a major obstacle to a successful journal-based mentored peer review program.32,33 Although not measured in this study, there is no question that establishing and maintaining this MPR program for the Special Issue with a limited number of annual submissions (65–160) requires a substantive investment of time and administrative support. Such resources may not be available to journals with limited staff or resources.33

Other factors that may affect success include the culture and mission of the journal and the degree to which they have access to a “fellowship” pool. Finally, the generalizability of our findings to journals with a much larger annual submission rate may be restricted by the limited impact of such a program on their editorial process.

CONCLUSION

The development of a formal educational opportunity in mentored peer reviews for emergency medicine education fellowships has had a significant impact on our editorial review process. The size of our reviewer pool continues to increase annually in a manner that appears sustainable. Peer-review quality improved, while editorial review turnaround times decreased.

Footnotes

Section Editor: Jeffrey Druck, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No other author has professional or financial relationships with any companies that are relevant to this study. There are no other conflicts of interest or sources of funding to declare.

REFERENCES

  • 1.Ware M, Mabe M. The STM report: an overview of scientific and scholarly journal publishing. Netherlands: International Association of Scientific, Technical and Medical Publishers; 2015. [Google Scholar]
  • 2.Kovanis M, Porcher R, Ravaud P, et al. The global burden of journal peer review in the biomedical literature: strong imbalance in the collective enterprise. PLoS One. 2016;11(11):e0166387. doi: 10.1371/journal.pone.0166387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ghasemi A, Mirmiran P, Kashfi K, et al. Scientific publishing in biomedicine: a brief history of scientific journals. Int J Endocrinol Metab. 2022;21(1):e131812. doi: 10.5812/ijem-131812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Peterson CJ, Orticio C, Nugent K. The challenge of recruiting peer reviewers from one medical journal’s perspective. Proc (Bayl Univ Med Cent) 2022;35(3):394–396. doi: 10.1080/08998280.2022.2035189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hames I. Peer review in a rapidly evolving publishing landscape. In: Campbell R, Pentz E, Borthwick I, editors. Academic and professional publishing. Oxford England: Chandos Publishing.; 2012. pp. 15–52. [Google Scholar]
  • 6.DeLisi LE. Where have all the reviewers gone? Is the peer review concept in crisis? Psychiatry Res. 2022;310:114554. doi: 10.1016/j.psychres.2022.114454. [DOI] [PubMed] [Google Scholar]
  • 7.Thomas SP. Current controversies regarding peer review in scholarly journals. Issues Ment Health Nurs. 2018;39(2):99–101. doi: 10.1080/01612840.2018.1431443. [DOI] [PubMed] [Google Scholar]
  • 8.Fernandez-Llimos F. Peer review and publication delay. Pharm Pract (Granada) 2019;17(1):1502. doi: 10.18549/PharmPract.2019.1.1502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chloros GD, Giannoudis VP, Giannoudis PV. Peer-reviewing in surgical journals: revolutionize or perish? Ann Surg. 2022;275(1):e82–e90. doi: 10.1097/SLA.0000000000004756. [DOI] [PubMed] [Google Scholar]
  • 10.Shomoossi N, Shomoossi Z, Rad M. Stressing the need for the pool of trained peer reviewers versus authors’ suggested reviewers. J Med Edu Dev. 2023;16(48):78–79. [Google Scholar]
  • 11.Nicholas D, Watkinson A, Jamali HR, et al. Peer review: still king in the digital age. Learn Pub. 2015;28(1):15–21. [Google Scholar]
  • 12.Kirk RB, Saravanan S, de Beer A, et al. The trainee as reviewer: training the next generation of scholars. Med Educ. 2026;60(2):187–188. doi: 10.1111/medu.70039. [DOI] [PubMed] [Google Scholar]
  • 13.Mulligan A, Hall L, Raphael E. Peer review in a changing world: an international study measuring the attitudes of researchers. J Assoc Inf Sci Technol. 2013;64(1):132–161. [Google Scholar]
  • 14.Tite L, Schroter S. Why do peer reviewers decline to review? A survey. J Epidemiol Community Health. 2007;61(1):9–12. doi: 10.1136/jech.2006.049817. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Snell L, Spencer J. Reviewers’ perceptions of the peer review process for a medical education journal. Med Educ. 2005;39(1):90–97. doi: 10.1111/j.1365-2929.2004.02026.x. [DOI] [PubMed] [Google Scholar]
  • 16.Watling C, Ginsburg S, Lingard L. Don’t be Reviewer 2! Reflections on writing effective peer review comments. Perspect Med Educ. 2021;10(5):29–303. doi: 10.1007/s40037-021-00670-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.DeMaria AN. What constitutes a great review? J Am Coll of Cardiol. 2003;42(7):1314–1315. doi: 10.1016/j.jacc.2003.08.020. [DOI] [PubMed] [Google Scholar]
  • 18.Mayer D, Eastin C, Kane B, et al. The importance of peer review skills and the value and necessity of training residents to ensure continued scientific excellence. AEM Educ Train. 2024;8:S76–S79. doi: 10.1002/aet2.10940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Warne V. Rewarding reviewers—sense or sensibility? A Wiley study explained. Learn Publ. 2016;29(1):41–50. [Google Scholar]
  • 20.Smith R. Peer review: a flawed process at the heart of science and journals. J R Soc Med. 2006;99(4):178–182. doi: 10.1258/jrsm.99.4.178. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Azer SA, Ramani S, Peterson R. Becoming a peer reviewer to medical education journals. Acad Med. 2012;34(9):698–704. doi: 10.3109/0142159X.2012.687488. [DOI] [PubMed] [Google Scholar]
  • 22.Way DP, Bierer SB, Cianciolo AT, et al. Fundamentals of scholarly peer review: a workshop for health professions educators on practicing scholarly citizenship. MedEdPORTAL. 2021;17:11174. doi: 10.15766/mep_2374-8265.11174. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bruce R, Chaucin A, Trinquart L, et al. Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis. BMC Med. 2016;14(1):1–6. doi: 10.1186/s12916-016-0631-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Ross JC, Martin A, Han SP. Finding our voice—scholarship in peer review. Clin Teach. 2023;20(1):1. doi: 10.1111/tct.13551. [DOI] [PubMed] [Google Scholar]
  • 25.Van Rooyen S. The evaluation of peer-review quality. Learn Publ. 2001;14(2):85–91. [Google Scholar]
  • 26.Schroter S, Black N, Evans S, et al. Effects of training on quality of peer review: randomized controlled trial. BMJ. 2004;328(7441):1–5. doi: 10.1136/bmj.38023.700775.AE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Callaham ML, Wears RL, Waeckerle JF. Effect of attendance at a training session on peer reviewer quality and performance. Ann Emerg Med. 1998;32:318–322. doi: 10.1016/s0196-0644(98)70007-1. [DOI] [PubMed] [Google Scholar]
  • 28.Wong VSS, Strowd RE, III, Aragon-Garcia R, et al. Mentored peer review of standardized manuscripts as a teaching tool for residents: a pilot randomized controlled multicenter study. Res Integr Peer Rev. 2017;2(1):1–9. doi: 10.1186/s41073-017-0032-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Richards BF, Cardell EM, Chow CJ, et al. Discovering the benefits of group peer review of submitted manuscripts. Teach Learn Med. 2020;32(1):104–109. doi: 10.1080/10401334.2019.1657870. [DOI] [PubMed] [Google Scholar]
  • 30.Ilgen JS, Artino AR, Simpson D, et al. Group peer review: the breakfast of champions. J Grad Med Educ. 2016;8(5):646–649. doi: 10.4300/JGME-D-16-00531.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Sidalak D, Purdy E, Luckett-Gatopoulos S, et al. Coached peer review: developing the next generation of authors. Acad Med. 2016;92(2):201–204. doi: 10.1097/ACM.0000000000001224. [DOI] [PubMed] [Google Scholar]
  • 32.Lyons-Warren AM, Aamodt WW, Pieper KM, et al. A structured, journal-led peer-review mentoring program enhances peer review training. Res Integr Peer Rev. 2024;9(1):3–11. doi: 10.1186/s41073-024-00143-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Houry D, Green S, Callaham M. Does mentoring new peer reviewers improve review quality? A randomized controlled trial. BMC Med Educ. 2012;12(1):1–7. doi: 10.1186/1472-6920-12-83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Dumenco L, Engle DL, Goodell K, et al. Expanding group peer review: a proposal for medical education scholarship. Acad Med. 2017;92(2):147–149. doi: 10.1097/ACM.0000000000001384. [DOI] [PubMed] [Google Scholar]
  • 35.Council of Residency Directors in Emergency Medicine. Mission/vision. [Accessed January 2, 2020]. Available at: https://www.cordem.org/about-cord/mission--vision/mission--vision/
  • 36.Love JN, Merritt C, Ilgen JS, et al. A collaborative approach to mentored peer reviews sponsored by the Council of Residency Directors of Emergency Medicine. West J Emerg Med. 2024;25(1):111–116. doi: 10.5811/westjem.61488. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Love JN, Messman AM, Ilgen JS, et al. Development and validation of a scoring rubric for editorial assessment of peer-review quality. West J Emerg Med. 2024;25(2):1–10. doi: 10.5811/westjem.18432. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Eva KW. Altruism as enlightened self-interest: how helping others through peer review helps you. Med Educ. 2021;55(8):880–882. doi: 10.1111/medu.14584. [DOI] [PubMed] [Google Scholar]
  • 39.Björk BC, Solomon D. The publishing delay in scholarly peer-reviewed journals. J Informetr. 2013;7(4):914–923. [Google Scholar]
  • 40.Tenopir C, Dalton E, Fish A, et al. What motivates authors of scholarly articles? The importance of journal attributes and potential audience on publication choice. Publ. 2016;4(3):22. [Google Scholar]

Articles from Western Journal of Emergency Medicine are provided here courtesy of The University of California, Irvine

RESOURCES