Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Mar 23;15(3):e0230417. doi: 10.1371/journal.pone.0230417

The impact of low- versus high-intensity surveillance cystoscopy on surgical care and cancer outcomes in patients with high-risk non-muscle-invasive bladder cancer (NMIBC)

Michael E Rezaee 1,2, Kristine E Lynch 3, Zhongze Li 4, Todd A MacKenzie 4,5, John D Seigne 1,6, Douglas J Robertson 1,5, Brenda Sirovich 1,5, Philip P Goodney 1,5, Florian R Schroeck 1,2,5,6,*
Editor: Francisco X Real7
PMCID: PMC7089561  PMID: 32203532

Abstract

Purpose

To assess the association of low- vs. guideline-recommended high-intensity cystoscopic surveillance with outcomes among patients with high-risk non-muscle invasive bladder cancer (NMIBC).

Materials & methods

A retrospective cohort study of Veterans Affairs patients diagnosed with high-risk NMIBC between 2005 and 2011 with follow-up through 2014. Patients were categorized by number of surveillance cystoscopies over two years following diagnosis: low- (1–5) vs. high-intensity (6 or more) surveillance. Propensity score adjusted regression models were used to assess the association of low-intensity cystoscopic surveillance with frequency of transurethral resections, and risk of progression to invasive disease and bladder cancer death.

Results

Among 1,542 patients, 520 (33.7%) underwent low-intensity cystoscopic surveillance. Patients undergoing low-intensity surveillance had fewer transurethral resections (37 vs. 99 per 100 person-years; p<0.001). Risk of death from bladder cancer did not differ significantly by low (cumulative incidence [CIn] 8.4% [95% CI 6.5–10.9) at 5 years) vs. high-intensity surveillance (CIn 9.1% [95% CI 7.4–11.2) at 5 years, p = 0.61). Low vs. high-intensity surveillance was not associated with increased risk of bladder cancer death among patients with Ta (CIn 5.7% vs. 8.2% at 5 years p = 0.24) or T1 disease at diagnosis (CIn 10.2% vs. 9.1% at 5 years, p = 0.58). Among patients with Ta disease, low-intensity surveillance was associated with decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death (CIn 19.3% vs. 31.3% at 5 years, p = 0.002).

Conclusions

Patients with high-risk NMIBC undergoing low- vs. high-intensity cystoscopic surveillance underwent fewer transurethral resections, but did not experience an increased risk of progression or bladder cancer death. These findings provide a strong rationale for a clinical trial to determine whether low-intensity surveillance is comparable to high-intensity surveillance for cancer control in high-risk NMIBC.

1. Introduction

Bladder cancer is a common genitourinary malignancy with over 700,000 individuals diagnosed with the disease in the United States.[1] Non-muscle invasive bladder cancer (NMIBC) accounts for approximately 70–80% of bladder cancer diagnoses and is associated with substantially lower morbidity and mortality compared to muscle invasive disease.[2] After tissue diagnosis and staging, NMIBC can be risk stratified based on the probability of tumor recurrence or progression to muscle-invasive disease. Patients with high-risk lesions (high grade Ta, T1, or carcinoma in situ [CIS]) have up to an 80% risk of recurrence and up to a 50% risk of progression over 5 years.[2] As such, patients with high-risk NMIBC represent a unique population that may benefit from more aggressive treatment and surveillance practices.

After transurethral resection and possible intra-vesical therapy, patients with NMIBC undergo surveillance cystoscopy to assess for disease recurrence over time. Frequency of cystoscopy can vary as there are different surveillance recommendations for NMIBC amongst oncologic organizations.[3] For high-risk disease, the American Urological Association (AUA) recommends cystoscopy every 3–4 months for 2 years, every 6 months for an additional 2 years, and then annually.[4] The National Comprehensive Cancer Network recommends cystoscopy every 3–6 months for the first 2 years and then at “increasing intervals” afterwards.[5] However, these guidelines are based on minimal scientific data and mainly on expert opinion. Such limitations create gaps in evidence-based care and may contribute to patients undergoing more cystoscopies than needed.

We previously reported that approximately one-third of patients with high-risk NMIBC or CIS underwent fewer surveillance cystoscopies than recommended (i.e. low-intensity surveillance).[6] However, whether low-intensity surveillance among patients with high-risk NMIBC is associated with unfavorable outcomes is unknown. Our objective was to assess the association of low- vs. guideline-recommended high-intensity cystoscopic surveillance with key clinical outcomes, including frequency of transurethral resections, progression to invasive disease, and bladder cancer death.

2. Materials & methods

2.1 Study population

We conducted a retrospective cohort study of all Department of Veterans Affairs (VA) patients older than 65 years diagnosed with high-risk NMIBC according to the European Association of Urology guidelines (i.e., high grade Ta, CIS, or T1)[7] between 2005 and 2011 with follow-up through 2014. As previously described,[6] a validated algorithm was used to identify 2,152 patients with newly diagnosed high-risk (high grade Ta, T1, or CIS) urothelial cell carcinoma of the bladder using national VA data. Pathologic information was extracted via validated natural language processing (NLP) algorithms.[8] Patients were excluded if they had missing covariates (n = 173). We also a priori excluded patients who died or had their last contact with the VA health system during the first two years after diagnosis, as this was the time period during which we measured intensity of surveillance (n = 437, 153 died from bladder cancer, 262 from other causes, 2 from unknown cause, and 20 had last contact within 2 years). The final analysis sample consisted of 1,542 patients.

2.2 Defining low- versus high-intensity cystoscopic surveillance

We defined intensity of cystoscopic surveillance according to the number of procedures received over a 2-year surveillance window. The surveillance window began with the NMIBC diagnosis date and ended 2 years after diagnosis or at the time of cystectomy, radiotherapy, or cancer recurrence, whichever came first. We did not enumerate cystoscopies after a cancer recurrence, because a recurrence increases risk for further recurrences, warrants additional resections, and thus “restarts the surveillance clock.” Recurrences were identified from full-text pathology reports using the validated NLP algorithms.[8] We identified cystoscopy procedures using Current Procedural Terminology (CPT) codes as previously described[6] and categorized patients into those that received low- versus high-intensity surveillance based on current consensus guideline recommendations and the length of the surveillance window (Fig 1).[9,10,11] The surveillance window was evaluated by the following intervals: up to 5.5 months, 5.5 up to 9.5, 9.5 up to 13.5, 13.5 up to 17.5, 17.5 up to 21.5, and over 21.5 months. The rationale for these intervals was that surveillance cystoscopy at 4, 8, 12, 16, 20, and 24 months is recommended for high-risk bladder cancer by the AUA.[12] A 1.5 month grace period was allotted to allow for surveillance cystoscopies that were performed slightly later than recommended.

Fig 1. Categorizing patients into low versus high-intensity surveillance based on consensus guideline recommendations and length of the surveillance window.

Fig 1

[3] At the top of the figure, the timeline of the surveillance window is depicted in months. X denotes the recommended time of cystoscopy. A 1.5 month grace period was allotted to allow for surveillance cystoscopies that were done slightly later than recommended. For example, a patient followed for 9.5 months (second column) who underwent 0 or 1 cystoscopies was categorized as low-intensity surveillance, whereas a patient followed for 9.5 months who underwent 2 or more cystoscopies was categorized as high-intensity surveillance. In the table, the number of patients categorized into low versus high-intensity surveillance (overall and stratified by length of surveillance window), and number of surveillance cystoscopies is depicted.

2.3 Outcomes

The outcomes of interest were number of transurethral resections, number of resections with and without cancer in the specimen, progression to invasive disease (T1 or T2), and bladder cancer death. First, we enumerated transurethral resections (including cystoscopy with biopsy) during a 2- to 9-year follow-up period using CPT and International Classification of Diseases (ICD), Ninth Revision, procedure codes as previously defined.[13] The follow-up period for our outcomes analysis started with the date of diagnosis and ended with the date of cystectomy, radiotherapy, cancer recurrence, death, last contact with the VA system, or at the end of the study (December 31, 2014), whichever came first. Resections performed less than 30 days apart were not considered in the enumeration of transurethral resections. This was done to avoid over-counting of re-resections or resections that were erroneously entered more than once in the medical record.

Second, the number of resections with and without cancer in the specimen was determined using validated NLP algorithms of VA pathology data.[8] Third, date of death was obtained from the VA Corporate Data Warehouse Vital status File, while cause of death was acquired from the National Death Index (NDI).[14] Bladder cancer death was defined using ICD, tenth revision, codes from the NDI.[13] Lastly, NLP algorithms were used to identify patients with Ta disease who progressed to invasive disease. Of note, progression to invasive disease included progression to any invasive disease, including invasion into the lamina propria (T1) or into the muscularis propria (T2). This was done because the NLP algorithms are limited in their ability to differentiate between invasion into the lamina propria versus muscularis propria, likely due to the large variation in language used by pathologists to describe these findings.[8]

2.4 Statistical analysis

We first compared patient characteristics by low and high-intensity surveillance cystoscopy status using descriptive statistics. We then performed a series of propensity score adjusted analyses to assess the association between low- versus high-intensity surveillance and primary study outcomes. Propensity scores were calculated for each patient as the probability of undergoing low-intensity surveillance conditional on patient baseline characteristics listed in Table 1.[15,16]

Table 1. Baseline patient characteristics of 1,542 patients diagnosed with high-risk NMIBC stratified by low versus-high intesity cystoscopic surveillance.

  Total / All patients (n = 1542) High intensity surveillance (n = 1022) Low intensity surveillance (n = 520) P-value *
Age (median, IQR) 77 (66–95) 76 (66–95) 77 (66–94) 0.04
Age ≥80 (N, %) 555 (36) 343 (33.6) 212 (40.8) <0.01
Male Sex (N, %)** >1531 (>99.2) >1011 (>98.9) >509 (>97.8) 0.33
Race (N, %)        
    White** >1273 (>82.5) >856 (>83.7) 414 (79.6) 0.04
    Black 113 (7.3) 60 (5.9) 53 (10.2)  
    Asian** 14 (0.9) 11 (1.1) <11 (<2.2)  
    Hispanic** 23 (1.5) 16 (1.6) <11 (<2.2)  
    Native American** <11 (<0.8) <11 (<1.1) <11 (<2.2)  
    Unknown 108 (7) 68 (6.7) 40 (7.7)  
Comorbidity (N, %)        
    0 226 (14.7) 142 (13.9) 84 (16.2) 0.39
    1 403 (26.1) 273 (26.7) 130 (25)  
    2 404 (26.2) 277 (27.1) 127 (24.4)  
    ≥3 509 (33) 330 (32.3) 179 (34.4)  
Nosos-p score *** (median, IQR) 1.6 (0.4–7.5) 1.7 (0.5–7.5) 1.5 (0.4–7.3) 0.01
Year of diagnosis (N, %)        
    2005 33 (2.1) 20 (2) 13 (2.5) 0.33
    2006 182 (11.8) 121 (11.8) 61 (11.7)  
    2007 222 (14.4) 140 (13.7) 82 (15.8)  
    2008 267 (17.3) 164 (16) 103 (19.8)  
    2009 269 (17.4) 184 (18) 85 (16.3)  
    2010 312 (20.2) 215 (21) 97 (18.7)  
    2011 257 (16.7) 178 (17.4) 79 (15.2)  
Proportion living in ZIP code with ≥25% college graduates (N, %) 645 (41.8) 436 (42.7) 209 (40.2) 0.35
Living in urban vs. rural area (N, %)        
    Urban 929 (60.2) 608 (59.5) 321 (61.7) 0.40
    Rural 613 (39.8) 414 (40.5) 199 (38.3)  
Stage        
    Ta (high grade or associated with carcinoma in situ) 599 (38.8) 404 (39.5) 195 (37.5) 0.69
    T1 872 (56.5) 570 (55.8) 302 (58.1)  
    Carcinoma in situ only 71 (4.6) 48 (4.7) 23 (4.4)  
Carcinoma in situ 330 (21.4) 227 (22.2) 103 (19.8) 0.28
Bladder Cancer Grade        
    Low**** 196 (12.7) 123 (12) 73 (14) 0.26
    High 1346 (87.3) 899 (88) 447 (86)  
Intravesical Therapy (N,%)***** 859 (56) 597 (58) 262 (50) <0.01

* From Chi-square test for categorical variable and Wilcoxon test for continuous variables whose median and IQR were presented. Missing observations were excluded for analysis.

** Exact numbers not shown to protect confidentiality.

*** The Nosos-p score is a risk-adjustment score based on diagnosis codes, biographic information (including gender, date of birth, insurance coverage, race, marital status, VA priority (priority 1–9), and inclusion in a VA registry), drug prescription data and utilization costs. The “-p” indicates it is a prospective score, using data from one fiscal year to predict future health care utilization in the next fiscal year.

**** Low-grade tumors were only included if they were T1 or associated with carcinoma in situ.

***** Not included in initial propensity score adjustment. However, all Fine-Gray models were adjusted for receipt on intravesical chemotherapy.

First, propensity score adjusted Poisson regression was used to assess the association of low- versus high-intensity cystoscopic surveillance with frequency of transurethral resections, overall and with and without cancer in the specimen. Second, propensity adjusted Fine-Gray competing risks regression was used to assess the association of surveillance intensity with risk of bladder cancer death. These Fine-Gray regressions were also adjusted for receipt of intravesical therapy during the surveillance period, which was ascertained using VA administrative and pharmacy data. Death from causes other than bladder cancer was modeled as a competing risk. This analysis step was stratified by Ta (high-grade or associated with CIS) versus T1 disease at the time of diagnosis, as well as surveillance intensity.

Third, a similar Fine-Gray regression model was used to assess the relationship between surveillance intensity and a combined outcome of progression to invasive disease (T1 or T2) or bladder cancer death among a subset of patients diagnosed with Ta disease. These outcomes were combined, because both of them represent an undesirable cancer outcome. As described above, progression to invasive disease (T1 or T2) could only be accurately measured among patients diagnosed with Ta disease due to NLP limitations. Thus, this model was run only for this subset of patients.

Finally, we performed sensitivity analyses to assess whether the exclusion of patients who died or had their last contact with the VA health system during the first two years after diagnosis affected our results. We re-calculated the propensity score on the cohort without implementing this exclusion and then refitted the Fine-Gray regression models to assess the relationship between intensity of surveillance and outcomes.

To standardize reporting and demonstrate effect size, numbers of resections were reported per 100 person-years. A p-value < 0.05 was used for statistical significance. The study was approved by the Veteran’s Institutional Review Board of Northern New England (#897920) and the University of Utah Institutional Review Board (#00079402). Study data were not fully anonymized as pathology was extracted from full text pathology reports which included patient identifiers. Data were accessed between January 2015 and February 2020 via the secure VA Informatics and Computing Infrastructure. Informed written consent was waived for the study. Analyses were performed using SAS Enterprise Guide 7.15 and Stata v15.1.

3. Results

3.1 Low- versus high-intensity cystoscopic surveillance

Of the 1,542 patients diagnosed with high-risk NMIBC, 520 (33.7%) underwent low-intensity surveillance over the two-year follow up period. Patients who underwent low-intensity surveillance were less likely to be white (79.6% vs. 84.4%, p<0.01) compared to high-intensity surveillance patients (Table 1), and a lower proportion of them were treated with intravesical therapy (50.4% vs. 58.4%, p<0.01). Fig 1 displays the surveillance window associated with each guideline recommended cystoscopy interval time point (delineated by red X). The surveillance window was 21.5 to 24 months for 458 (88.1%) patients who underwent low-intensity surveillance compared to 365 (35.7%) patients who underwent high-intensity surveillance (p<0.001, Fig 1). The surveillance window tended to be longer among patients who underwent low-intensity surveillance, because a lower proportion of them experienced a recurrence within the first 2 years (69 of 520 (13.3%) vs 655 of 1022 patients (64.1%); p<0.001). Median number of cystoscopies was 4 and 7 for patients who underwent low and high-intensity surveillance over at least 21.5 months, respectively (Fig 1).

3.2 Intensity of cystoscopic surveillance & outcomes

After propensity score adjustment, patients who underwent low-intensity surveillance had almost 3-times fewer transurethral resections (37 [95% Confidence Interval (CI) 34–41] vs. 99 [95% CI 93–101] per 100 person-years; p<0.001) compared to those who underwent high-intensity surveillance. Similarly, low-intensity surveillance patients underwent approximately 3-times fewer resections with cancer in the specimen (28 [95% CI 25–31] vs. 77 [95% CI 72–83) per 100 person-years, p<0.001), and 2-times fewer resections without cancer in the specimen (7.5 [95% CI 6.5–8.7] vs. 16 [95% CI 15–18] per 100 person-years; p<0.001).

There were a total of 143 bladder cancer deaths during a median follow-up of 4.6 years. After adjustment for propensity score and receipt of intravesical therapy, risk of death from bladder cancer did not differ significantly by low (cumulative incidence [CIn] 8.4% [95% CI 6.5–10.9] at 5 years) vs. high-intensity surveillance (CIn 9.1% [95% CI 7.4–11.2] at 5 years, p = 0.61). Patients were then stratified by Ta versus T1 disease at the time of diagnosis, as well as surveillance intensity. Low vs. high-intensity surveillance was not associated with risk of bladder cancer death among patients with Ta (CIn 5.7% vs. 8.2% at 5 years p = 0.24) or with T1 disease at diagnosis (CIn 10.2% vs. 9.1% at 5 years, p = 0.58, Fig 3A). Among patients with Ta disease, low-intensity surveillance was associated with decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death (CIn 19.3% vs. 31.3% at 5 years, p = 0.002, Fig 3B).

Fig 3.

Fig 3

Cumulative incidence plots showing the probability of 1) bladder cancer death by Ta versus T1 disease and by cystoscopic surveillance intensity (Panel A) and 2) progression to invasive disease (T1 or T2) or bladder cancer death among those with Ta disease (Panel B). Data are from Fine and Gray competing risk models adjusted for propensity score and receipt of intravesical therapy with death from other causes modeled as a competing risk.

In sensitivity analyses, now including any patients who died or had their last contact with the VA health system during the first two years after diagnosis, we found very similar results. Again, risk of death from bladder cancer did not differ significantly by low (CIn 13.1% [95% CI 10.7–16.0] at 5 years) vs. high-intensity surveillance (CIn 14.9% [95% CI 13.1–16.9] at 5 years, p = 0.27). Results among patients stratified by Ta versus T1 disease were also essentially unchanged, with no apparent differences in bladder cancer death between low- and high intensity surveillance (Fig 2).

Fig 2. Sensitivity analyses, now including any patients who died or had their last contact with the VA health system during the first two years after diagnosis.

Fig 2

Cumulative incidence plots showing the probability of 1) bladder cancer death by Ta versus T1 disease and by cystoscopic surveillance intensity (Panel A) and 2) progression to invasive disease (T1 or T2) or bladder cancer death among those with Ta disease (Panel B). Data are from Fine and Gray competing risk models adjusted for propensity score and receipt of intravesical therapy with death from other causes modeled as a competing risk.

4. Discussion

We found that low-intensity surveillance was associated with 3-times fewer total transurethral resections in patients who underwent low versus guideline-recommended high-intensity cystoscopic surveillance of high-risk NMIBC (high grade Ta, T1, or CIS). There was no difference in risk of death from bladder cancer by surveillance intensity. Among a subset of patients with Ta disease, low-intensity surveillance was associated with decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death.

To the best of our knowledge, we are the first to assess the association of low- vs. guideline-recommended high-intensity cystoscopic surveillance with outcomes in high-risk NMIBC patients. Our results suggest that there is no increased risk of disease progression or bladder cancer death in older patients with high-risk NMIBC who undergo low-intensity surveillance (Fig 3A). While the optimal surveillance intensity for high-risk NMIBC is unknown, low-intensity cystoscopic surveillance may be reasonable based on our results. It was associated with 3-times fewer transurethral resections compared to high-intensity surveillance (Fig 4). Thus, one of the benefits of low-intensity surveillance may be decreasing a patient’s exposure to peri-operative risks and complications associated with repetitive cystoscopy and transurethral resection, including urinary tract infection, hematuria, and anesthesia complications.[17,18] In addition, low-intensity surveillance has the potential to decrease unnecessary testing and transurethral resections in patients with high-risk NMIBC given the difference in the number of transurethral resections we observed between the low- and high-intensity surveillance groups.

Fig 4. Number of total transurethral resctions and resections with cancer in the pathology specimen by low versus high-intensity surveillance.

Fig 4

Patients who underwent low-intensity surveillance experienced 3-times fewer total transurethral resections and resection with cancer in the specimen compared to high-intensity surveillance patients.

Among a subset of patients diagnosed with Ta disease, low-intensity surveillance was associated with a decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death (Fig 3B). One would expect that low-intensity surveillance would delay the detection of recurrences and thus should increase the risk of progression to invasive disease (T1 or T2) or bladder cancer death. We found the opposite. Given the observational nature of our data, it is possible that urologists managed certain high-risk NMIBC patients with low-intensity surveillance based on intra-operative and patient characteristics not measured in our study. For example, tumor size and number of tumors were not available in our pathologic data as this was abstracted via NLP from full text bladder cancer pathology reports.[8] Urologists may have followed solitary or small high-risk lesions less intensely compared to multi-focal or larger lesions, resulting in unmeasured additional risk-stratification by urologists. Thus, patients who underwent low-intensity surveillance may have had an inherently lower risk of progression than those undergoing high-intensity surveillance (i.e. unmeasured confounding). This may also suggest that distinct subpopulations of high-risk bladder cancer patients exist that can be managed more similarly to patients with low-risk disease, which should be evaluated in future prospective studies. Further, high-intensity surveillance (looking more often) likely leads to earlier detection of progressive disease. In a time-to-event analysis, time to disease progression or death would then be substantially shorter in patients undergoing high-intensity surveillance, resulting in a higher calculated risk of progression. We believe that the higher risk of progression among patients undergoing high-intensity surveillance is likely due to a combination of unobserved confounding and earlier detection.

There are additional limitations of this study to consider. First, our study was performed in VA patients older than 65 years of age, which may limit the generalizability of our results to the general population. VA patients have more co-morbidities and poorer socioeconomic status compared to the general population.[19] However, the majority of new bladder cancer cases in the United States occur in men older than 65 years of age,[20] which our cohort adequately represents. Second, we had a moderate length of follow up (median 4.6 years) to assess for differences in outcomes. Studies examining longer-term follow up are required to determine if our findings persist over time. Third, as discussed above, it’s difficult to understand why some patients underwent low-intensity surveillance not in accordance with AUA guidelines. In prior work, we identified African American race, no comorbidity, and male provider gender as factors associated with underuse of surveillance.[21] However, there are likely a number of other unmeasured confounders in our study that influence surveillance intensity. Lastly, we did not assess the potential impact of adjunct testing/imaging (e.g. cross-sectional imaging, ultrasound, biomarkers, or cytology) that may have influenced surveillance cystoscopy practices.

The primary strengths of our study include a large sample size and examination of outcomes that are important to both patients and physicians. Further, the use of full-text pathology reports provided a level of detail that allowed us to ascertain progression to invasive disease. This overcomes a weakness of commonly used oncological databases, such as the National Cancer Database and Surveillance Epidemiology and End Results-Medicare database, which do not contain specific detail on resections performed for suspected cancer recurrence.[22,23]

Our study has important implications as the findings suggest that less intensive surveillance might be reasonable for patients with high-risk NMIBC, in contrary to what is currently recommended by major oncologic organizations.[3] Evidence supporting these recommendations is insufficient, which is explicitly stated in the AUA guideline.[4,12] Perhaps due to the lack of strong evidence, adherence to these surveillance recommendations is known to be poor.[24,25] In the present study, 33.7% high-risk NMIBC patients underwent less frequent cystoscopy than recommended, but did not have an increased risk of progression to bladder cancer death. These cumulative findings suggest that the optimal cystoscopic surveillance intensity for patients with high-risk NMIBC needs to be established using rigorous research methods.

5. Conclusion

Patients with high-risk NMIBC undergoing low-intensity cystoscopic surveillance underwent fewer transurethral resections than those with high-intensity surveillance, but did not experience an increased risk of disease progression or bladder cancer death. These findings suggest that less intensive surveillance might be reasonable for patients with high-risk NMIBC. However, given the retrospective nature of this study, our findings are subject to unmeasured confounding. Thus, we do not advocate for lower intensity surveillance of high-risk NMIBC based on our findings. Rather, we believe our study provides a strong rationale for a future randomized trial to assess whether low-intensity surveillance of patients with high-risk NMIBC is comparable to high-intensity surveillance in terms of cancer control.

Acknowledgments

This study was supported using resources and facilities at the White River Junction Department of Veterans Affairs (VA) Medical Center, the VA Salt Lake City Health Care System, and the VA Informatics and Computing Infrastructure (VINCI), VA HSR RES 13–457. Support for VA and Centers for Medicare & Medicaid Services data is provided with support from the VA Information Resource Center, Project Numbers SDR 02–237 and 98–004. We acknowledge programming assistance by Benjamin Viernes, MPH.

Disclaimer: Opinions expressed in this manuscript are those of the authors and do not constitute official positions of the U.S. Federal Government or the Department of Veterans Affairs.

Data Availability

Data cannot be shared publicly because they contain potentially identifying and sensitive patient information. Data are available via the Veteran's IRB of Northern New England (contact via email: vhawrjresearchtask@va.gov) for researchers who meet the criteria for access to confidential Department of Veterans Affairs data. Data in the Department of Veterans Affairs Corporate Data Warehouse are collected for clinical purposes as part of the patient medical record. They contain potentially identifying and sensitive patient information and, therefore, cannot be shared. They can be accessed by any VA researcher through the Institutional Review Board process. Interested researchers can direct data access requests to the director of the Veteran's IRB of Northern New England, 215 N Main Street, White River Junction, VT 05009, phone 802-295-9363, email: vhawrjresearchtask@va.gov

Funding Statement

FRS is supported by a Conquer Cancer Foundation Career Development Award and by the Dow-Crichlow Award of the Department of Surgery at the Dartmouth-Hitchcock Medical Center. PPG is supported by the Department of Veterans Affairs Health Services Research & Development (IIR 15-085, 1I01HX001880-01A2). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

References

  • 1.National Cancer Institute. Cancer Stat Facts: Bladder Cancer. https://seer.cancer.gov/statfacts/html/urinb.html. Published 2018. Accessed March 30, 2019.
  • 2.Sylvester RJ, van der Meijden AP, Oosterlinck W, et al. Predicting recurrence and progression in individual patients with stage Ta T1 bladder cancer using EORTC risk tables: a combined analysis of 2596 patients from seven EORTC trials. Eur Urol. 2006;49(3):466–465; discussion 475–467. 10.1016/j.eururo.2005.12.031 [DOI] [PubMed] [Google Scholar]
  • 3.Woldu SL, Bagrodia A, Lotan Y. Guideline of guidelines: non-muscle-invasive bladder cancer. BJU international. 2017;119(3):371–380. 10.1111/bju.13760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.American Urological Association. Diagnosis and Treatment of Non-Muscle Invasive Bladder Cancer: AUA/SUO Joint Guidline (2016). Bladder Cancer Non-Muscle Invasive Guideline Web site. https://www.auanet.org/guidelines/bladder-cancer-non-muscle-invasive-guideline. Published 2016. Accessed April 25 2019.
  • 5.National Comprehensive Cancer Network. Bladder Cancer. NCCN Guidelines Version 5.2018 Web site. https://www.nccn.org/store/login/login.aspx?ReturnURL = https://www.nccn.org/professionals/physician_gls/pdf/bladder.pdf. Published 2018. Accessed April 25, 2019.
  • 6.Schroeck FR, Lynch KE, Chang Jw, et al. Extent of Risk-Aligned Surveillance for Cancer Recurrence Among Patients With Early-Stage Bladder Cancer. JAMA Network Open. 2018;1(5):e183442–e183442. 10.1001/jamanetworkopen.2018.3442 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Babjuk M, Bohle A, Burger M, et al. EAU Guidelines on Non-Muscle-invasive Urothelial Carcinoma of the Bladder: Update 2016. Eur Urol. 2017;71(3):447–461. 10.1016/j.eururo.2016.05.041 [DOI] [PubMed] [Google Scholar]
  • 8.Schroeck FR, Patterson OV, Alba PR, et al. Development of a Natural Language Processing Engine to Generate Bladder Cancer Pathology Data for Health Services Research. Urology. 2017;110:84–91. 10.1016/j.urology.2017.07.056 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Schroeck FR, Smith N, Shelton JB. Implementing risk-aligned bladder cancer surveillance care. Urol Oncol. 2018;36(5):257–264. 10.1016/j.urolonc.2017.12.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Schroeck FR, Sirovich B, Seigne JD, Robertson DJ, Goodney PP. Assembling and validating data from multiple sources to study care for Veterans with bladder cancer. BMC Urol. 2017;17(1):78 10.1186/s12894-017-0271-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hollenbeck BK, Ye Z, Dunn RL, Montie JE, Birkmeyer JD. Provider treatment intensity and outcomes for patients with early-stage bladder cancer. J Natl Cancer Inst. 2009;101(8):571–580. 10.1093/jnci/djp039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Chang SS, Boorjian SA, Chou R, et al. Diagnosis and Treatment of Non-Muscle Invasive Bladder Cancer: AUA/SUO Guideline. J Urol. 2016;196(4):1021–1029. 10.1016/j.juro.2016.06.049 [DOI] [PubMed] [Google Scholar]
  • 13.Schroeck FR, Lynch KE, Li Z, et al. The impact of frequent cystoscopy on surgical care and cancer outcomes among patients with low-risk, non-muscle-invasive bladder cancer. Cancer. 2019;125:3147–3154. 10.1002/cncr.32185 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Center of Excellence for Suicide Prevention. Joint Department of Veterans Affairs (VA) and Department of Defense (DoD) Suicide Data Repository—Natioanl Death Index (NDI). https://www.dspo.mil/Portals/113/Documents/SDR%20Fact%20Sheet.pdf. Published 2017. Accessed August 30, 2017.
  • 15.Quan H, Sundararajan V, Halfon P, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43(11):1130–1139. 10.1097/01.mlr.0000182534.19832.83 [DOI] [PubMed] [Google Scholar]
  • 16.Wagner TH, Upadhyay A, Cowgill E, et al. Risk Adjustment Tools for Learning Health Systems: A Comparison of DxCG and CMS-HCC V21. Health Serv Res. 2016;51(5):2002–2019. 10.1111/1475-6773.12454 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Gregg JR, McCormick B, Wang L, et al. Short term complications from transurethral resection of bladder tumor. Can J Urol. 2016;23(2):8198–8203. [PubMed] [Google Scholar]
  • 18.Hollenbeck BK, Miller DC, Taub D, et al. Risk factors for adverse outcomes after transurethral resection of bladder tumors. Cancer. 2006;106(7):1527–1535. 10.1002/cncr.21765 [DOI] [PubMed] [Google Scholar]
  • 19.Agha Z, Lofgren RP, VanRuiswyk JV, Layde PM. Are Patients at Veterans Affairs Medical Centers Sicker?: A Comparative Analysis of Health Status and Medical Resource Use. JAMA Internal Medicine. 2000;160(21):3252–3257. [DOI] [PubMed] [Google Scholar]
  • 20.Noone AM, Howlader N, Krapcho M. Seer Cancer Statistics Review, 1975–2015. Bethesda MD: Natl Cancer Inst; http://seer.cancer.gov/csr/1975_2015/. Published 2018. Accessed May 26th, 2019. [Google Scholar]
  • 21.Han DS, Swanton AR, Lynch KE, et al. Patient, provider, and faclity factors associated with underuse of guideline recommended surveillance for high-risk non-muscle invasive bladder cancer—a national study. Urological Society for American Veterans; 2018; Chicago, Illinois.
  • 22.Warren JL, Klabunde CN, Schrag D, Bach PB, Riley GF. Overview of the SEER-Medicare data: content, research applications, and generalizability to the United States elderly population. Med Care. 2002;40(8 Suppl):Iv–3-18. [DOI] [PubMed] [Google Scholar]
  • 23.Merkow RP, Rademaker AW, Bilimoria KY. Practical Guide to Surgical Data Sets: National Cancer Database (NCDB). JAMA Surg. 2018;153(9):850–851. 10.1001/jamasurg.2018.0492 [DOI] [PubMed] [Google Scholar]
  • 24.Schrag D, Hsieh LJ, Rabbani F, Bach PB, Herr H, Begg CB. Adherence to surveillance among patients with superficial bladder cancer. J Natl Cancer Inst. 2003;95(8):588–597. 10.1093/jnci/95.8.588 [DOI] [PubMed] [Google Scholar]
  • 25.Chamie K, Saigal CS, Lai J, et al. Compliance with guidelines for patients with bladder cancer: variation in the delivery of care. Cancer. 2011;117(23):5392–5401. 10.1002/cncr.26198 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Francisco X Real

5 Feb 2020

PONE-D-20-01946

The impact of low- versus high-intensity surveillance cystoscopy on surgical care and cancer outcomes in patients with high-risk non-muscle-invasive bladder cancer (NMIBC)

PLOS ONE

Dear Dr. Rezaee,

Thank you for submitting your manuscript to PLOS ONE.

Both reviewers concur that the topic is important and the issue raised is not settled. They also concur that such an important question will not be answered conclusively by a retrospective study. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. You should respond to all the comments of the referees providing the requested information and should tone down your conclusions by taking into consideration the limitations derived from the study design and the possible imbalances in the two study groups.

We would appreciate receiving your revised manuscript within 3 months. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Francisco X. Real

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

1. In the ethics statement in the manuscript and in the online submission form, please provide additional information about the patient records used in your retrospective study, including: a) whether all data were fully anonymized before you accessed them; b) the date range (month and year) during which patients' medical records were accessed; and c) the source of the medical records analyzed in this work (e.g. hospital, institution or medical center name). If patients provided informed written consent to have data from their medical records used in research, please include this information.

2. Thank you for including the following funding statement in your manuscript; " FRS is supported by a Conquer Cancer Foundation Career Development Award and by the Dow-Crichlow Award of the Department of Surgery at the DartmouthHitchcock Medical Center. PPG is supported by the Department of Veterans Affairs Health Services Research & Development (IIR 15-085, 1I01HX001880-01A2). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"none"

3. Thank you for including your competing interests statement; "none"

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now

 This information should be included in your cover letter; we will change the online submission form on your behalf.

4. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a retrospective study on a specific database of patients with high-risk non-muscle-infiltrating bladder cancer. This database also provides reliable follow-up (only 195 lost for follow-up of a total of more than 2100 patients). In this database, the diagnostic profitability and oncological results of establishing a narrow cystoscopic follow-up (one cystoscopy every 4 months minimum) or more lax (less than one cystoscopy every 4 months) are studied, finding that there are no differences between the two follow-ups.

It is an attractive study, with results that push to a more lax follow up, and tries to fill a real world clinical gap. However, the work has the following limitations:

- The exclusion of patients deceased by bladder cancer during the first two years of follow-up must be better explained. It is likely that these patients were part of a closer follow-up and more tumor resections were performed. I would propose to include those patients who died from bladder cancer who had undergone a review with at least one cystoscopy without tumor recurrence. In this way, an attempt is made to exclude patients in whom a non-infiltrating bladder tumor was mistakenly diagnosed in the beginning. To know in which group they are placed, the number of cystoscopies performed is divided into the time spent from initial resection to the diagnosis of the tumor (less than 3 cystoscopies/year or more than 3c/year)

- As the authors point out, the number of tumors is not reflected, which can be an important confounding factor in the cystoscopy rhythm and the results obtained.

- It is not specified whether the follow-up was replaced by other means (ultrasound, CAT Scan…) or if other urothelial tumors (upper urinary tract) were detected during the follow up. These results may influence the results presented.

- The percentage of patients over 80 years in the low intensity group is higher, and that may have influenced in not performing resection of asymptomatic tumors detected.

- Also, it has to be said that some low risk tumours may have been detected, but not operated or biopsied. This may influence the results presented.

- The grouping between non-infiltrating tumors (Ta) and CIS is not correct: High grade Ta may have around a 10% risk of progression, while the CIS can reach 50% (figure 3). This analysis should be reconsidered only with Ta vs T1 if the number of patients with CIS is too small.

Reviewer #2: The authors have assessed the association of low- vs. guideline-recommended high-intensity

cystoscopic surveillance with outcomes among patients with high-risk NMIBC analyzing a retrospective cohort study of Veterans Affairs patients (> 75) diagnosed with high-risk disease between 2005 and 2011 with follow-up through 2014

They found that patients with high-risk NMIBC undergoing low- vs. high-intensity cystoscopic surveillance underwent fewer transurethral resections, but did not experience an increased risk of progression or bladder cancer death

General comments

The evidence behind the frequency of cystoscopies in the follow-up of NMIBC is particularly poor and not supported by any level one evidence. Numerous studies including a previous one by the same group of authors (but mainly in low grade disease) have clearly outlined a major risk of overuse for various reasons.

Therefore the attempt to correlate the frequency of cystoscopic examinations by the authors should be commended and addresses a real unmet need.

Although the results are nicely presented and the authors have done their very best to honestly analyze and criticize their findings nevertheless the reader is left with the impression that the low and high frequency groups may not have been similar, therefore weakening any robust conclusions.

1.The confounder and possible bias is patients with low intensity might have had a better prognosis and less recurrences (even the high risk NMIBC group is heterogenous as outlined by the authors in their discussion); so the treating urologist might have had the tendency to space follow-up.

2. After propensity score adjustment, patients who underwent low-intensity surveillance had almost 3-times fewer transurethral resections compared to those who underwent high-intensity surveillance: In high grade NMIBC, especially given the fact that these patients usually receive BCG leading to bladder inflammation, it is reasonable to assume that more frequent cystos led to a higher chance that the urologists would see something she/he didn't like, decided to err on side of caution and therefore resect, isn't it?

3.The surveillance window tended to be longer among patients who underwent low-intensity surveillance,

because a lower proportion of them experienced a recurrence within the first 2 years (69

of 520 (13.3%) vs 655 of 1022 patients (64.1%); p<0.001).

This is honestly difficult to reconcile and grasp. It seems that despite the matching, groups were imbalanced in terms of risk of recurrence/progression.

4.Among patients with non-invasive disease (high grade Ta/CIS), low-intensity surveillance was associated with decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death (CIn 19.3% vs. 31.4% at 5 years, p=0.002, Figure Panel 3B)- This is again very difficult to understand?? Why would any lower surveillance be associated with decreased risk of progression unless low intensity surveillance was performed in lower risk populations - the authors acknowledge that it is possible that urologists

managed certain high-risk NMIBC patients with low-intensity surveillance based on intra-operative and patient characteristics not measured in their study.Urologists may have followed solitary or small high-risk lesions less intensely compared to multi-focal or larger tumors

In conclusion, this is a nicely written paper on an important topic but the conclusions are not fully supported by the data presented and would benefit from being tempered.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Mar 23;15(3):e0230417. doi: 10.1371/journal.pone.0230417.r002

Author response to Decision Letter 0


27 Feb 2020

Response to Reviewers

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

1. In the ethics statement in the manuscript and in the online submission form, please provide additional information about the patient records used in your retrospective study, including: a) whether all data were fully anonymized before you accessed them; b) the date range (month and year) during which patients' medical records were accessed; and c) the source of the medical records analyzed in this work (e.g. hospital, institution or medical center name). If patients provided informed written consent to have data from their medical records used in research, please include this information.

We have added the following to the ethics statement in the manuscript:

“Study data were not fully anonymized as pathology was extracted from full text pathology reports which included patient identifiers. Data were accessed between January 2015 and February 2020 via the secure VA Informatics and Computing Infrastructure. Informed written consent was waived for the study.”

2. Thank you for including the following funding statement in your manuscript; " FRS is supported by a Conquer Cancer Foundation Career Development Award and by the Dow-Crichlow Award of the Department of Surgery at the DartmouthHitchcock Medical Center. PPG is supported by the Department of Veterans Affairs Health Services Research & Development (IIR 15-085, 1I01HX001880-01A2). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement.

Thank you. We have removed the funding statement from the manuscript. We would like our funding statement to read as:

“FRS is supported by a Conquer Cancer Foundation Career Development Award and by the Dow-Crichlow Award of the Department of Surgery at the Dartmouth-Hitchcock Medical Center. PPG is supported by the Department of Veterans Affairs Health Services Research & Development (IIR 15-085, 1I01HX001880-01A2). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.”

3. Thank you for including your competing interests statement; "none"

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now

This information should be included in your cover letter; we will change the online submission form on your behalf.

4. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

This manuscript was submitted by the first author: Michael E. Rezaee (ORCID iD 0000-0002-6236-8682). However, we would greatly appreciate it if you could list the senior author, Florian R. Schroeck (ORCID iD 0000-0002-1860-2611) as the final corresponding author.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

For clarification:

Data in the Department of Veterans Affairs Corporate Data Warehouse are collected for clinical purposes as part of the patient medical record. They contain potentially identifying and sensitive patient information and, therefore, cannot be shared. They can be accessed by any VA researcher through the Institutional Review Board process. Interested researchers can direct data access requests to the director of the Veteran's IRB of Northern New England, 215 N Main Street, White River Junction, VT 05009, phone 802-295-9363, email: vhawrjresearchtask@va.gov

Data cannot be shared publicly because they contain potentially identifying and sensitive patient information. Data are available via the Veteran's IRB of Northern New England (contact via email: vhawrjresearchtask@va.gov) for researchers who meet the criteria for access to confidential Department of Veterans Affairs data

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a retrospective study on a specific database of patients with high-risk non-muscle-infiltrating bladder cancer. This database also provides reliable follow-up (only 195 lost for follow-up of a total of more than 2100 patients). In this database, the diagnostic profitability and oncological results of establishing a narrow cystoscopic follow-up (one cystoscopy every 4 months minimum) or more lax (less than one cystoscopy every 4 months) are studied, finding that there are no differences between the two follow-ups.

It is an attractive study, with results that push to a more lax follow up, and tries to fill a real world clinical gap. However, the work has the following limitations:

- The exclusion of patients deceased by bladder cancer during the first two years of follow-up must be better explained. It is likely that these patients were part of a closer follow-up and more tumor resections were performed. I would propose to include those patients who died from bladder cancer who had undergone a review with at least one cystoscopy without tumor recurrence. In this way, an attempt is made to exclude patients in whom a non-infiltrating bladder tumor was mistakenly diagnosed in the beginning. To know in which group they are placed, the number of cystoscopies performed is divided into the time spent from initial resection to the diagnosis of the tumor (less than 3 cystoscopies/year or more than 3c/year)

We decided a priori to exclude patients who died or had their last contact with the VA health system during the first two years after diagnosis, as this was the time period during which we measured intensity of surveillance. These patients had a limited opportunity to be exposed to cystoscopic surveillance, which was the primary exposure being evaluated in the study. However, we understand the reviewer’s concern regarding this decision. To address this, we have now performed additional sensitivity analyses: We re-ran all models and re-evaluated bladder cancer death as well as progression to invasive bladder cancer or bladder cancer death without excluding these patients. Also, all patients included in the study had at least one surveillance cystoscopy.

We have added the following to the methods in the analyses section:

“Finally, we performed sensitivity analyses to assess whether the exclusion of patients who died or had their last contact with the VA health system during the first two years after diagnosis affected our results. We re-calculated the propensity score on the cohort without implementing this exclusion and then refitted the Fine-Gray regression models to assess the relationship between intensity of surveillance and outcomes.”

We found the following and added this to the Results section along with new Figure 4:

“In sensitivity analyses, now including any patients who died or had their last contact with the VA health system during the first two years after diagnosis, we found very similar results. Again, risk of death from bladder cancer did not differ significantly by low (CIn 13.1% [95% CI 10.7-16.0] at 5 years) vs. high-intensity surveillance (CIn 14.9% [95% CI 13.1-16.9] at 5 years, p=0.27). Results among patients stratified by Ta versus T1 disease were also essentially unchanged, with no apparent differences in bladder cancer death between low- and high intensity surveillance (Figure 4).”

- As the authors point out, the number of tumors is not reflected, which can be an important confounding factor in the cystoscopy rhythm and the results obtained.

We agree that this is an important limitation of the study that is discussed in the discussion section of the paper.

- It is not specified whether the follow-up was replaced by other means (ultrasound, CAT Scan…) or if other urothelial tumors (upper urinary tract) were detected during the follow up. These results may influence the results presented.

Per AUA guidelines patients with high-risk NMIBC should undergo surveillance cystoscopy at specific time points. Upper tract evaluation with a CT Urogram or bilateral retrogrades can be considered every 1-2 years for high-risk disease. We did not evaluate the potential role of other modalities for disease surveillance (bladder ultrasound, CT Urogram, biomarkers, etc.) because direct visualization with cystoscopy is the standard of care for disease surveillance. It’s possible that other modalities could have assisted in identifying disease recurrence. However, it’s unlikely that a significant percentage of patients in our study underwent non-guideline recommended imaging/testing for surveillance purposes. We have added this as a potential limitation of the study to the discussion section:

“Lastly, we did not assess the potential impact of adjunct testing/imaging (e.g. cross-sectional imaging, ultrasound, biomarkers, or cytology) that may have influenced surveillance cystoscopy practices. ”

- The percentage of patients over 80 years in the low intensity group is higher, and that may have influenced in not performing resection of asymptomatic tumors detected.

There are clearly observed differences between patients undergoing low- versus high-intensity cystoscopic surveillance. As can be seen in Table 1, this includes differences in age, among others. All of these differences were accounted for in our propensity score and propensity score adjusted models.

- Also, it has to be said that some low risk tumours may have been detected, but not operated or biopsied. This may influence the results presented.

It would be atypical for a patient with a history of high-risk NMIBC to have a tumor recurrence seen on surveillance cystoscopy, but not have the tumor resected or biopsied because it visually appears low grade. Even if this happened in rare instances, low-grade tumors are unlikely to affect outcomes such as progression to invasive disease and bladder cancer death.

- The grouping between non-infiltrating tumors (Ta) and CIS is not correct: High grade Ta may have around a 10% risk of progression, while the CIS can reach 50% (figure 3). This analysis should be reconsidered only with Ta vs T1 if the number of patients with CIS is too small.

We have redone the analyses, now stratifying patients into Ta vs. T1 disease. This is reflected in the updated results and updated Figure 3 as well as in new Figure 4. The findings have remained unchanged.

Reviewer #2: The authors have assessed the association of low- vs. guideline-recommended high-intensity cystoscopic surveillance with outcomes among patients with high-risk NMIBC analyzing a retrospective cohort study of Veterans Affairs patients (> 75) diagnosed with high-risk disease between 2005 and 2011 with follow-up through 2014

They found that patients with high-risk NMIBC undergoing low- vs. high-intensity cystoscopic surveillance underwent fewer transurethral resections, but did not experience an increased risk of progression or bladder cancer death

General comments

The evidence behind the frequency of cystoscopies in the follow-up of NMIBC is particularly poor and not supported by any level one evidence. Numerous studies including a previous one by the same group of authors (but mainly in low grade disease) have clearly outlined a major risk of overuse for various reasons.Therefore the attempt to correlate the frequency of cystoscopic examinations by the authors should be commended and addresses a real unmet need.

Although the results are nicely presented and the authors have done their very best to honestly analyze and criticize their findings nevertheless the reader is left with the impression that the low and high frequency groups may not have been similar, therefore weakening any robust conclusions.

1.The confounder and possible bias is patients with low intensity might have had a better prognosis and less recurrences (even the high risk NMIBC group is heterogenous as outlined by the authors in their discussion); so the treating urologist might have had the tendency to space follow-up.

Confounding and selection bias is a limitation of all retrospective cohort studies to some degree. We have attempted to limit this bias with propensity score adjustment. However, there are likely unmeasured confounders that influence an urologist’s surveillance cystoscopy practices. We have discussed many of these potential factors in the discussion section. We agree that additional research is needed to determine the optimal timing and frequency of surveillance cystoscopy among patients with high-risk NMIBC.

2. After propensity score adjustment, patients who underwent low-intensity surveillance had almost 3-times fewer transurethral resections compared to those who underwent high-intensity surveillance: In high grade NMIBC, especially given the fact that these patients usually receive BCG leading to bladder inflammation, it is reasonable to assume that more frequent cystos led to a higher chance that the urologists would see something she/he didn't like, decided to err on side of caution and therefore resect, isn't it?

We agree that our findings are very plausible: looking more often likely lead to more abnormal cystoscopies and thus more transurethral sections.

3.The surveillance window tended to be longer among patients who underwent low-intensity surveillance, because a lower proportion of them experienced a recurrence within the first 2 years (69 of 520 (13.3%) vs 655 of 1022 patients (64.1%); p<0.001). This is honestly difficult to reconcile and grasp. It seems that despite the matching, groups were imbalanced in terms of risk of recurrence/progression.

We agree that there is concern for residual imbalance between the groups and associated unmeasured confounding. We have discussed this extensively in the discussion section as well as in the response to item #4 below.

4.Among patients with non-invasive disease (high grade Ta/CIS), low-intensity surveillance was associated with decreased risk of progression to invasive disease (T1 or T2) or bladder cancer death (CIn 19.3% vs. 31.4% at 5 years, p=0.002, Figure Panel 3B)- This is again very difficult to understand?? Why would any lower surveillance be associated with decreased risk of progression unless low intensity surveillance was performed in lower risk populations - the authors acknowledge that it is possible that urologists managed certain high-risk NMIBC patients with low-intensity surveillance based on intra-operative and patient characteristics not measured in their study. Urologists may have followed solitary or small high-risk lesions less intensely compared to multi-focal or larger tumors

We agree that this finding in particular is difficult to understand. This finding suggests that patients diagnosed with high-risk bladder cancer can undergo vastly different surveillance strategies and that those undergoing low-intensity surveillance may somehow represent a lower risk, “high risk” population. This further begs the need to determine optimal surveillance strategies for patients with high-risk disease, ideally in prospective randomized studies. There are likely tumor and patient characteristics that require more or less frequent surveillance cystoscopy than what is currently recommended by the AUA.

In conclusion, this is a nicely written paper on an important topic but the conclusions are not fully supported by the data presented and would benefit from being tempered.

Thank you. We have tempered our conclusion:

“Patients with high-risk NMIBC undergoing low-intensity cystoscopic surveillance underwent fewer transurethral resections than those with high-intensity surveillance, but did not experience an increased risk of disease progression or bladder cancer death. These findings suggest that less intensive surveillance might be reasonable for patients with high-risk NMIBC. However, given the retrospective nature of this study, our findings are subject to unmeasured confounding. Thus, we do not advocate for lower intensity surveillance of high-risk NMIBC based on our findings. Rather, we believe our study provides a strong rationale for a future randomized trial to assess whether low-intensity surveillance of patients with high-risk NMIBC is comparable to high-intensity surveillance in terms of cancer control.”

Attachment

Submitted filename: Plos One Response to Reviewers_2_25_2020.docx

Decision Letter 1

Francisco X Real

2 Mar 2020

The impact of low- versus high-intensity surveillance cystoscopy on surgical care and cancer outcomes in patients with high-risk non-muscle-invasive bladder cancer (NMIBC)

PONE-D-20-01946R1

Dear Dr. Rezaee,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Francisco X. Real

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: After reading the new manuscript, all my comments addressed and adequately changed. I have no objection for publication.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Francisco X Real

9 Mar 2020

PONE-D-20-01946R1

The impact of low- versus high-intensity surveillance cystoscopy on surgical care and cancer outcomes in patients with high-risk non-muscle-invasive bladder cancer (NMIBC)

Dear Dr. Rezaee:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Francisco X. Real

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Plos One Response to Reviewers_2_25_2020.docx

    Data Availability Statement

    Data cannot be shared publicly because they contain potentially identifying and sensitive patient information. Data are available via the Veteran's IRB of Northern New England (contact via email: vhawrjresearchtask@va.gov) for researchers who meet the criteria for access to confidential Department of Veterans Affairs data. Data in the Department of Veterans Affairs Corporate Data Warehouse are collected for clinical purposes as part of the patient medical record. They contain potentially identifying and sensitive patient information and, therefore, cannot be shared. They can be accessed by any VA researcher through the Institutional Review Board process. Interested researchers can direct data access requests to the director of the Veteran's IRB of Northern New England, 215 N Main Street, White River Junction, VT 05009, phone 802-295-9363, email: vhawrjresearchtask@va.gov


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES