Skip to main content
PLOS One logoLink to PLOS One
. 2020 Jul 23;15(7):e0235902. doi: 10.1371/journal.pone.0235902

Development of a definition and rules for causal attribution of post-colonoscopy bleeding

Robert J Hilsden 1,2,*, Courtney M Maxwell 3, Nauzer Forbes 1,2, Ronald J Bridges 1, Alaa Rostom 4, Catherine Dube 4, Devon Boyne 2, Darren Brenner 2,5, Steven J Heitman 1,2
Editor: Roberto Coppola6
PMCID: PMC7377473  PMID: 32701949

Abstract

Background

Post-colonoscopy bleeding (PCB) is an important colonoscopy quality indicator that is recommended to be routinely collected by colorectal cancer screening programs and endoscopy quality improvement programs. We created a standardized and reliable definition of PCB and set of rules for attributing the relatedness of PCB to a colonoscopy.

Methods

PCB events were identified from colonoscopies performed at the Forzani & MacPhail Colon Cancer Screening Centre. Existing definitions and relatedness rules for PCB were reviewed by the authors and a draft definition and set of rules was created. The definition and rules were revised after initial testing was performed using a set of 15 bleeding events. Information available for each event included the original endoscopy report and data abstracted from the emergency or inpatient record by a trained research assistant. A validation set of 32 bleeding events were then reviewed to assess their interrater reliability by having three endoscopists and one research assistant complete independent reviews and three endoscopists complete a consensus review. The Kappa statistic was used to measure interrater reliability.

Results

The panel classified 28 of 32 events as meeting the definition of PCB and rated 7, 8 and 6 events as definitely, probably and possibly related to the colonoscopy, respectively. The Kappa for the definition of PCB for the three independent reviews was 0.82 (substantial agreement). The Kappa for the attribution of the PCB to the colonoscopy by the three endosocopists was 0.74 (substantial agreement). The research assistant had a high agreement with the panel for both the definition (100% agreement) and application of the causal criteria (kappa 0.95).

Conclusions

A standardized definition of PCB and attribution rules achieved high interrater reliability by endoscopists and a non-endoscopist and provides a template of required data for event adjudication by screening and quality improvement programs.

Introduction

As organized screening for colorectal cancer has become commonplace, there has been a growing emphasis on monitoring the quality of colonoscopy. One critical indicator of colonoscopy quality is the rate of serious adverse events, such as bleeding and perforation. A recent meta-analysis reported the rate of bleeding based on 15 population-level studies to be 2.4 per 1,000 colonoscopies. [13] However, the lack of standardized and reliable definitions of post-colonoscopy bleeding and causal attribution rules could prevent valid comparisons of rates across programs or research studies.

The purpose of this study was to create a standardized and reliable definition of post-colonoscopy bleeding and a set of rules for attributing the bleeding event to a colonoscopy that could be applied by a non-physician research assistant. The secondary purpose was to create a set of core data elements required for assessing post-colonoscopy bleeding.

Materials and methods

Study design and patients

The study was conducted at the Alberta Health Services’ Forzani & MacPhail Colon Cancer Screening Centre (CCSC) in Calgary, AB, Canada. The Centre is a publicly-funded endoscopy unit that only provides colonoscopies related to screening for colorectal cancer, including primary screening, post-polypectomy surveillance and diagnostic colonoscopy following a positive fecal immunochemical test. Colonoscopies performed for other indications, such as the investigation of signs or symptoms of gastrointestinal disease, are performed at hospital endoscopy units. All patients must be free of medical conditions that would place them at higher risk for colonoscopy-related adverse events (ASA Class I/II & select Class III). All patients undergo a consultation appointment with a trained nurse. Those who do not meet the Centre’s eligibility criteria are redirected elsewhere. Colonoscopies at the Centre are performed by gastroenterologists and colorectal surgeons who also perform endoscopies at hospital endoscopy units.

The Centre maintains a quality improvement program that includes the identification of all emergency room visits and inpatient hospitalizations occurring within 30 days of a colonoscopy. Events are identified by linking a patient’s unique personal health care number to the provincial ambulatory care database (emergency room visits) and discharge abstract database (inpatient stays). Additional information on all events is obtained by a review of the emergency room and/or inpatient chart by a trained research assistant.

For this study, we used post-colonoscopy bleeding events that occurred after colonoscopies performed from 2008 to 2014. Two sets of bleeding events were used in this study. The cases included in the two sets were selected to represent a range of bleeding events (clearly related to clearly unrelated). Information for each case included the anonymized index colonoscopy report, second colonoscopy (procedure performed to evaluate bleeding) report, and data abstracted from the emergency and inpatient charts.

This study received IRB approval by the Health Research Ethics Board of Alberta (HREBA.CC-18-0702), which granted a waiver from the requirement to obtain written informed consent. All data was originally collected by the CCSC’s quality improvement program. Two members of the study team (RJH, CMM) had access to identifiable data, whereas the remaining study team only had access to anonymized patient information.

Creation of post-colonoscopy bleeding definition and attribution rules

We created an initial definition of post-colonoscopy bleeding after reviewing published clinical practice guidelines. Next we created a set of rules for the causal attribution of the bleeding event to the colonoscopy using a framework commonly employed in clinical trials. [4] All authors then reviewed the first set of 15 bleeding events using the definition and attribution rules. A panel meeting was then held where each bleeding case was reviewed and the ease of use and appropriateness of the rules were discussed. The draft versions were then modified to create the final post-colonoscopy bleeding definition and attribution rules.

Validation testing

The final post-colonoscopy bleeding definition and attribution rules were then evaluated in a second set of 32 bleeding events. Three endoscopists (RJH, NF, SH) as a panel reviewed each event to agree upon a consensus rating as to whether the event met the definition of post-colonoscopy bleeding and, if it did, how likely the event was due to the colonoscopy. They did twice, first using the criteria and second based on their overall global assessment. The panel’s global assessment was defined as the “gold standard.” Three other endoscopists (RB, CD, AR) reviewed and rated each event independently using the definition and attribution rules. Finally, a non-physician research assistant (CMM) experienced in abstracting adverse event data from colonoscopy and hospital records, reviewed and rated each event using the definition and attribution rules.

Statistical analysis

The causal attribution variable was ordinal with five possible responses: definitely related, probably related, possibly related, unlikely related or unrelated (Table 1). A binary causal attribution variable was also created by classifying cases as related to the colonoscopy (definitely, probably or possibly related) or unrelated (unlikely related or unrelated).

Table 1. Rules for attributing post-colonoscopy bleeding to the index colonoscopy.

Causal Attribution Criteria
Definite • Active bleeding or adherent clot identified at 2nd colonoscopy
Probable (must have 3) • Within 14 days of colonoscopy
• Hot snare polypectomy
• Polypectomy site with visible vessel at 2nd colonoscopy
• High risk polypectomy1
Possible (must have 2) • Within 14 days of colonoscopy
• Hot snare polypectomy
•Polypectomy site with visible vessel at 2nd colonoscopy
• High risk polypectomy1
Unlikely (must have 3) • 14 days after colonoscopy
• Biopsy, cold snare polypectomy or no polypectomy
• Low risk polypectomy
• No high risk stigmata2 or no 2nd colonoscopy
Unrelated • Alternative source of bleeding identified
• (Includes preparation-related Mallory-Weiss tears)

1 High risk polypectomy (any one of the following)

   1.  Size > 2cm.

   2. Size 1–2 cm plus any one of

      • Location: Proximal to the transverse colon.

      • Shape: Pedunculated.

      • Patient uses anti-platelet therapy or oral anticoagulant.

   3. Immediate post-polypectomy bleeding occurred that required intervention.

2 High risk Stigmata: Active bleeding, Adherent clot, Visible vessel.

Kappa statistics were used to assess the inter-rater reliability of the definition and causal attribution rules. The Kappa statistic quantifying the degree of agreement between the three clinicians, with respect to whether or not the event met the definition of a post-colonoscopy bleed, was estimated using the Nelson-Edward method. [5] The weighted Kappa statistic was used for the assessment of the causal attribution rules, as it is a five-point ordinal scale where a disagreement of one level between reviewers is less concerning than a disagreement of greater than one level. The model-based approach developed by Nelson and Edwards was used with quadratic weights to estimate the weighted Kappa statistic. [6] For both the binary and ordinal outcomes, we chose to use the Nelson-Edwards model-based approach because this method has been shown to provide more accurate estimates of inter-rater reliability that tend to be more conservative when compared to other methods. [6, 7] In addition, this model-based method can incorporate data from subjects who were not rated by one of the three clinicians, unlike other methods. [7]

The model-based kappa statistics were run using the modelkappa function (available at https://github.com/AyaMitani/modelkappa/) in R (R Core Team, Vienna, Austria). Descriptive statistics and estimation of Kappa statistics for causal attribution as a binary (related/unrelated) variable were performed using Stata version 15 (StataCorp LLC, College Station, Tx).

Results

Post-colonoscopy bleeding was defined as “patient or health care provider reported rectal bleeding (other than blood on the toilet paper) and/or hemoglobin drop > 2 g/l within 30 days of a colonoscopy resulting in an emergency/urgent care center visit or hospital admission.” The final attribution rules are shown in Table 1.

The consensus panel classified 28 of 32 events as meeting the definition of post-colonoscopy bleeding. The four cases that did not meet the definition were upper gastrointestinal hemorrhages where the primary presenting symptoms included hematemesis. Of the 28 cases that met the definition of post-colonoscopy bleeding, the panel’s global assessment of causality classified 8, 13 and 1 event as definitely, probably and possibly related to the colonoscopy, respectively. The panel’s assessment was that 5 events were unlikely to be due to the colonoscopy and 1 event was unrelated to the colonoscopy. Therefore, when rating events as due to the colonoscopy (definite, probably, possible) or not due to the colonoscopy (unlikely, unrelated), 22 events were rated as due to the colonoscopy and 6 events were rated as not due to the colonoscopy.

When using the causal criteria, the panel’s consensus rating was 7, 8 and 6 events as being definitely, probably and possibly related to the colonoscopy, respectively. The panel rated 6 events as unlikely due to the colonoscopy and 1 event as unrelated to the colonoscopy.

The three independent reviewers classified 27, 27 and 29 events as meeting the definition of post-colonoscopy bleeding (kappa 0.82, 95% CI 0.59–1.0).

For the 32 events classified, the three independent reviewers had complete agreement on the classification of causality in 13 cases (unweighted Kappa 0.50, 95% CI 0.43–0.56). For only two of the cases did the reviewers disagree by more than one category (for example, definite and possibly). The weighted Kappa was 0.74 (95% confidence interval 0.68–0.80) indicating substantial agreement. When restricting to the 28 classified by the panel as meeting the definition of post-colonoscopy bleeding, the unweighted and weighted Kappas were 0.42 (95% CI 0.34–0.49) and 0.67 (95% CI 0.59 to 0.75) respectively.

There was similarly high agreement among the reviewers when events were rated as either due to or not due to the colonoscopy (kappa 0.79, 95% CI 0.54–1.0). When considering the panel’s global assessment as the gold standard, all three independent reviewers achieved a sensitivity of >95% and a specificity of 80%-100% for identifying a bleeding event due to a colonoscopy.

The research assistant was in complete agreement with the panel’s classification of 28 of 32 events as meeting the definition of post-colonoscopy bleeding. When applying the causal criteria, the research assistant classified 7, 8 and 6 events as definitely, probably or possibly related to the colonoscopy, which was in agreement with the panel. The RA rated 5 events as unlikely related and 2 events as unrelated, therefore disagreeing with the panel on one event (kappa 0.95, 95% CI 0.85–1.0).

The data elements required for determining whether a bleeding event met the definition of post-colonoscopy bleeding and for determining its causal relationship to the colonoscopy are shown in Table 2. Missing information, such as polyp size, shape and method of removal and a precise description of the bleeding, was noted to be a problem by the panel reviewers and research assistant.

Table 2. Data elements required for each bleeding event.

Index Colonoscopy
A) Patient:
antiplatelet agents, anticoagulants (yes/no)
B) Immediate Post-Polypectomy Bleeding (yes/no)
C)Polypectomy:
polypectomy with diathermy (hot)
polypectomy with no diathermy (cold)
no polypectomy
D) Polyp:
size (< 1 cm, 1–2 cm, > 2 cm)
shape (pedunculated, not pedunculated)
location proximal to transverse colon (yes/no)
Bleeding Event
A) Time (days) since index colonoscopy: (< = 14 days, > 14 days)
B) Description of bleeding
C) Change in hemoglobin (if available)
D) Second colonoscopy (to evaluate bleeding):
Done/Not done
If done: presence of active bleeding, adherent clot or visible vessel

Discussion

Post-colonoscopy bleeding, nearly always due to bleeding from a polypectomy site, is one of the procedure’s most common complications. Therefore, it is recognized as an important colonoscopy quality indicator. Polypectomy site bleeding can be immediate (during the procedure) or delayed (after discharge from the endoscopy unit). Immediate bleeding often can be easily managed at the time of the endoscopy and therefore often results in no material impact on the clinical course of the patient.

In 2008, the American Society for Gastrointestinal Endoscopy Quality Task Force convened a workshop on adverse events. The goals of this workshop included: (1) provide clear definitions for adverse events and (2) consider how to deal with delayed events, in particular, the issues of timing and attribution. Bleeding was defined as hematemesis and/or melena or hemoglobin drop > 2 grams. The report of the workshop recommended that adverse events be attributed to an endoscopic procedure using the ratings of definite, probable, possible or unlikely. However, no specific criteria were given to guide the use of these attributions.

In 2016, the British Society of Gastroenterology, the UK Joint Advisory Group on GI Endoscopy and the Association of Coloproctology of Great Britain and Ireland developed quality assurance measures specifically for colonoscopy. Post-polypectomy bleeding was defined as “rectal bleeding within 30 days of procedure resulting in any of the following”: unplanned post-procedure medical consultation, unplanned hospital admission or prolongation of hospital stay, hemoglobin drop of ≥ 2 g, transfusion, interventional procedure (endoscopic or radiological), surgery or death. The authors also recommended that “after root cause analysis, attribution of adverse events should be recorded as definite, probable, possible or unlikely.” Again, no specific criteria were given to guide the use of these attributions.

Several problems can be faced when applying either the ASGE or UK recommendations in the setting of a colonoscopy screening program. First, the ASGE lexicon was created for use with all endoscopic procedures. The definition of bleeding includes hematemesis and melena (black stools), which would be unusual for post-polypectomy bleeding. Furthermore, in the screening setting, patients may not have a recent hemoglobin measurement and therefore it may not be possible to determine if a 2 g/L drop occurred. Finally, rectal bleeding can be trivial (trace blood on the toilet paper) and unlikely to be of clinical importance or related to post-polypectomy bleeding.

Our definition of post-colonoscopy bleeding is “patient or health care provider reported rectal bleeding (other than blood on the toilet paper) and/or hemoglobin drop > 2 g/l within 30 days of a colonoscopy resulting in an emergency/urgent care center visit or hospital admission.” The key components of our definition includes: (1) we do not require objective medical evidence of bleeding by either a health care provider witnessing the bleeding or an objective drop in hemoglobin, (2) bleeding must be the passage of blood into the toilet and not just minor blood on the toilet paper, (3) we do accept an objective drop in hemoglobin to be adequate evidence of post-colonoscopy bleeding even if no rectal bleeding was noticed by the patient, and (4) bleeding must have resulted in the patient seeking urgent medical care. Our definition excludes immediate post-polypectomy bleeding that is controlled during the procedure and does not result in admission of the patient to hospital. It also excludes trivial or self-limited bleeding that neither impacts the patient nor generates a burden on the health care system.

We elected to exclude Mallory-Weiss tears, that can occur as a result of vomiting caused by the bowel preparation, from the events that would be included as a “Post-colonoscopy bleed.” However, such bleeding events can either meet or not meet our definition of post-colonoscopy bleeding. For example, a tear that resulted in isolated hematemesis would not meet the definition, whereas a tear that resulted in only rectal bleeding would meet the definition. In our study, the panel classified the four cases of upper GI bleeding that all resulted in hematemesis as not meeting the definition of post-colonoscopy bleeding.

When developing criteria for attributing bleeding events to a colonoscopy, we considered published risk factors for post-polypectomy bleeding. For instance, we concluded that a bleeding event would be more likely to be due to the index colonoscopy if a polypectomy with diathermy was performed than if polypectomy was performed by cold-snare without diathermy [810] or if no polypectomy was performed. [11] Other established predictors of post-polypectomy bleeding include the removal of large polyps (especially those > 2 cm), [1217] proximally located polyps [16, 1821] or pedunculated polyps. [16] Polypectomy on patients on antiplatelet agents or anticoagulants (even if discontinued before the procedure) has also been reported as a predictor of delayed bleeding, [14, 21] as has the occurrence of observed intraprocedural bleeding. [13, 19] Finally, we accepted that a colonoscopy performed to investigate bleeding could either confirm (if active bleeding from a polypectomy site was seen) or exclude (if an alternative bleeding site was seen) post-polypectomy bleeding.

By developing our definition of post-colonoscopy bleeding and attribution rules, we also defined the core data set required to apply them. This would assist quality assurance programs in establishing data collection procedures and minimizing the data required. However, all reviewers experienced challenges in applying the criteria when data was missing from the colonoscopy report. At times, reviewers had to infer polyp size and method of removal from image’s captured at the endoscopy. The research assistant was much less confident in making these inferences. Deficiencies in colonoscopy reports has been noted in several studies. [22] All of the polyp and polypectomy details required to be collected about the index colonoscopy are consistent with elements recommended by the Quality Assurance Task Group of the National Colorectal Cancer Roundtable to be part of a standard colonoscopy report. [23] Therefore, a high quality colonoscopy report should contain all information required to apply the criteria.

In summary, we have developed a definition of post-colonoscopy bleeding and a set of criteria for attributing the bleeding event to the colonoscopy based on information that should be routinely available in a colonoscopy report and emergency room/impatient chart that demonstrate high-interrater reliability and can be applied by a non-physician research assistant.

Data Availability

All datafiles are available from the Harvard Dataverse (Hilsden, Robert, 2019, "Attribution rules for post-colonoscopy bleeding", https://doi.org/10.7910/DVN/KXNYAS, Harvard Dataverse).

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Kothari ST, Huang RJ, Shaukat A, Agrawal D, Buxbaum JL, Abbas Fehmi SM, et al. ASGE review of adverse events in colonoscopy. Gastrointestinal Endoscopy. 2019;25:25 10.1016/j.gie.2019.07.033 . [DOI] [PubMed] [Google Scholar]
  • 2.Wu XR, Church JM, Jarrar A, Liang J, Kalady MF. Risk factors for delayed postpolypectomy bleeding: how to minimize your patients' risk. International Journal of Colorectal Disease. 2013;28(8):1127–34. 10.1007/s00384-013-1661-5 . [DOI] [PubMed] [Google Scholar]
  • 3.Buddingh KT, Herngreen T, Haringsma J, van der Zwet WC, Vleggaar FP, Breumelhof R, et al. Location in the right hemi-colon is an independent risk factor for delayed post-polypectomy hemorrhage: a multi-center case-control study. American Journal of Gastroenterology. 2011;106(6):1119–24. 10.1038/ajg.2010.507 [DOI] [PubMed] [Google Scholar]
  • 4.NCI Guidelines for investigators: adverse event reporting requirements for DCTD (CTEP and CIP) and CDP INDs and IDEs. 2013.
  • 5.Nelson KP, Edwards D. On population-based measures of agreement for binary classifications. Canadian Journal of Statistics. 2008;36(3):411–26. 10.1002/cjs.5550360306 [DOI] [Google Scholar]
  • 6.Nelson KP, Edwards D. Measures of agreement between many raters for ordinal classifications. Statistics in Medicine. 2015;34(23):3116–32. 10.1002/sim.6546 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Mitani AA, Freer PE, Nelson KP. Summary measures of agreement and association between many raters' ordinal classifications. Annals of Epidemiology. 2017;27(10):677–85.e4. 10.1016/j.annepidem.2017.09.001 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Papastergiou V, Paraskeva KD, Fragaki M, Dimas I, Vardas E, Theodoropoulou A, et al. Cold versus hot endoscopic mucosal resection for nonpedunculated colorectal polyps sized 6–10 mm: a randomized trial. Endoscopy. 2018;50(4):403–11. 10.1055/s-0043-118594 . [DOI] [PubMed] [Google Scholar]
  • 9.Yamashina T, Fukuhara M, Maruo T, Tanke G, Marui S, Sada R, et al. Cold snare polypectomy reduced delayed postpolypectomy bleeding compared with conventional hot polypectomy: a propensity score-matching analysis. Endosc Int Open. 2017;5(7):E587–E94. 10.1055/s-0043-105578 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Chang LC, Shun CT, Hsu WF, Tu CH, Chen CC, Wu MS, et al. Risk of delayed bleeding before and after implementation of cold snare polypectomy in a screening colonoscopy setting. Endosc Int Open. 2019;7(2):E232–E8. 10.1055/a-0810-0439 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Rabeneck L, Paszat LF, Hilsden RJ, Saskin R, Leddin D, Grunfeld E, et al. Bleeding and perforation after outpatient colonoscopy and their risk factors in usual clinical practice. Gastroenterology. 2008;135(6):1899–906. 10.1053/j.gastro.2008.08.058 [DOI] [PubMed] [Google Scholar]
  • 12.Watabe H, Yamaji Y, Okamoto M, Kondo S, Ohta M, Ikenoue T, et al. Risk assessment for delayed hemorrhagic complication of colonic polypectomy: polyp-related factors and patient-related factors. Gastrointestinal Endoscopy. 2006;64(1):73–8. 10.1016/j.gie.2006.02.054 . [DOI] [PubMed] [Google Scholar]
  • 13.Zhang Q, An S, Chen Z, Fu FH, Jiang B, Zhi F, et al. Assessment of risk factors for delayed colonic post-polypectomy hemorrhage: a study of 15553 polypectomies from 2005 to 2013. PLoS ONE. 2014;9(10):e108290 10.1371/journal.pone.0108290 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Sawhney MS, Salfiti N, Nelson DB, Lederle FA, Bond JH. Risk factors for severe delayed postpolypectomy bleeding. Endoscopy. 2008;40(2):115–9. 10.1055/s-2007-966959 . [DOI] [PubMed] [Google Scholar]
  • 15.Gimeno-Garcia AZ, de Ganzo ZA, Sosa AJ, Perez DN, Quintero E. Incidence and predictors of postpolypectomy bleeding in colorectal polyps larger than 10 mm. European Journal of Gastroenterology & Hepatology. 2012;24(5):520–6. [DOI] [PubMed] [Google Scholar]
  • 16.Kim JH, Lee HJ, Ahn JW, Cheung DY, Kim JI, Park SH, et al. Risk factors for delayed post-polypectomy hemorrhage: a case-control study. Journal of Gastroenterology & Hepatology. 2013;28(4):645–9. 10.1111/jgh.12132 . [DOI] [PubMed] [Google Scholar]
  • 17.Qumseya BJ, Wolfsen C, Wang Y, Othman M, Raimondo M, Bouras E, et al. Factors associated with increased bleeding post-endoscopic mucosal resection. J Dig Dis. 2013;14(3):140–6. 10.1111/1751-2980.12002 . [DOI] [PubMed] [Google Scholar]
  • 18.Buddingh KT, Herngreen T, Haringsma J, van der Zwet WC, Vleggaar FP, Breumelhof R, et al. Location in the right hemi-colon is an independent risk factor for delayed post-polypectomy hemorrhage: a multi-center case-control study. American Journal of Gastroenterology. 2011;106(6):1119–24. 10.1038/ajg.2010.507 . [DOI] [PubMed] [Google Scholar]
  • 19.Burgess NG, Metz AJ, Williams SJ, Singh R, Tam W, Hourigan LF, et al. Risk factors for intraprocedural and clinically significant delayed bleeding after wide-field endoscopic mucosal resection of large colonic lesions. Clinical Gastroenterology & Hepatology. 2014;12(4):651–61.e1-3. 10.1016/j.cgh.2013.09.049 . [DOI] [PubMed] [Google Scholar]
  • 20.Bahin FF, Rasouli KN, Byth K, Hourigan LF, Singh R, Brown GJ, et al. Prediction of Clinically Significant Bleeding Following Wide-Field Endoscopic Resection of Large Sessile and Laterally Spreading Colorectal Lesions: A Clinical Risk Score. American Journal of Gastroenterology. 2016;111(8):1115–22. 10.1038/ajg.2016.235 . [DOI] [PubMed] [Google Scholar]
  • 21.Metz AJ, Bourke MJ, Moss A, Williams SJ, Swan MP, Byth K. Factors that predict bleeding following endoscopic mucosal resection of large colonic lesions. Endoscopy. 2011;43(6):506–11. 10.1055/s-0030-1256346 . [DOI] [PubMed] [Google Scholar]
  • 22.Sharma RS, Rossos PG. A Review on the Quality of Colonoscopy Reporting. Can J Gastroenterol Hepatol. 2016;2016:9423142 10.1155/2016/9423142 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Lieberman D, Nadel M, Smith RA, Atkin W, Duggirala SB, Fletcher R, et al. Standardized colonoscopy reporting and data system: report of the Quality Assurance Task Group of the National Colorectal Cancer Roundtable. [Review] [32 refs]. Gastrointestinal Endoscopy. 2007;65(6):757–66. 10.1016/j.gie.2006.12.055 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Roberto Coppola

21 May 2020

PONE-D-19-35059

Development of a definition and rules for causal attribution of post-colonoscopy bleeding

PLOS ONE

Dear Dr. Hilsden,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 05 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Roberto Coppola, MD, FACS

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In the ethics statement in the manuscript and in the online submission form, please provide additional information about the patient records used in your retrospective study, including:

a) whether all data were fully anonymized before you accessed them;

b) the date range (month and year) during which patients' medical records were accessed;

c) the source of the medical records analyzed in this work (e.g. hospital, institution or medical center name).

If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Please amend either the abstract on the online submission form (via Edit Submission) or the abstract in the manuscript so that they are identical.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I appreciate the work done by the Authors. The topic is interesting and this paper could be useful in order to produce objective assessments regarding quality of colonoscopy. The methodology is accurate. Limitations have been discussed. I would only suggest making minor changes that can limit overlaps between introduction and discussion.

Reviewer #2: This is an interesting and useful paper proposing an objective evaluation of post-colonoscopy bleeding in a colorectal cancer screening setting.

I have no major criticisms.

The Discussion may be substantially shortened.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 23;15(7):e0235902. doi: 10.1371/journal.pone.0235902.r002

Author response to Decision Letter 0


18 Jun 2020

In preparing the revision, we have considered the comments of the two reviewers:

Reviewer #1: I appreciate the work done by the Authors. The topic is interesting and this paper could be useful in order to produce objective assessments regarding quality of colonoscopy. The methodology is accurate. Limitations have been discussed. I would only suggest making minor changes that can limit overlaps between introduction and discussion.

Reviewer #2: This is an interesting and useful paper proposing an objective evaluation of post-colonoscopy bleeding in a colorectal cancer screening setting.

I have no major criticisms.

The Discussion may be substantially shortened.

We have shortened the introduction to limit overlap between the introduction and the discussion. Because of these changes to the introduction, the discussion was kept largely intact.

We have added the requested additional details to the ethics section within the methods section. We were asked to provide (i) the date range during which patients’ medical records were accessed and (ii) the source of the medical records analyzed in this work. The data was originally collected by the institution’s quality improvement program. We were provided secondary use of this data for this study but did not directly access patients’ medical records. As the primary review of medical records was not performed as part of this research the requested data was not provided. The institution’s quality improvement program collected this data on an ongoing basis over the years 2008 - 2019 from all hospitals and urgent care centre’s in the province of Alberta and from the institution’s endoscopy report system.

We hope our revisions satisfy the reviewers and hope that our manuscript is now acceptable for publication in PLOS ONE.

Decision Letter 1

Roberto Coppola

25 Jun 2020

Development of a definition and rules for causal attribution of post-colonoscopy bleeding

PONE-D-19-35059R1

Dear Dr. Hilsden,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Roberto Coppola, MD, FACS

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

The Authors have entirely answered to the questions of the Reviewers.

This study is fascinating, and I am in favor of a publication in the Journal.

Reviewers' comments:

Acceptance letter

Roberto Coppola

8 Jul 2020

PONE-D-19-35059R1

Development of a definition and rules for causal attribution of post-colonoscopy bleeding

Dear Dr. Hilsden:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Roberto Coppola

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    All datafiles are available from the Harvard Dataverse (Hilsden, Robert, 2019, "Attribution rules for post-colonoscopy bleeding", https://doi.org/10.7910/DVN/KXNYAS, Harvard Dataverse).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES